Sep 30 22:07:17 devstack cinder-volume[76239]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 30 22:07:17 devstack cinder-volume[76239]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 22:07:17 devstack cinder-volume[76239]: we strongly recommend against using it for new projects. Sep 30 22:07:17 devstack cinder-volume[76239]: If you are already using Eventlet, we recommend migrating to a different Sep 30 22:07:17 devstack cinder-volume[76239]: framework. For more detail see Sep 30 22:07:17 devstack cinder-volume[76239]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 22:07:17 devstack cinder-volume[76239]: import eventlet # noqa Sep 30 22:07:19 devstack cinder-volume[76239]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 22:07:19 devstack cinder-volume[76239]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 22:07:19 devstack cinder-volume[76239]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 22:07:20 devstack cinder-volume[76239]: INFO dbcounter [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Registered counter for database cinder Sep 30 22:07:20 devstack cinder-volume[76239]: DEBUG oslo_db.sqlalchemy.engines [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:07:21 devstack cinder-volume[76239]: DEBUG dbcounter [-] [76239] Writer thread running {{(pid=76239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 22:07:21 devstack cinder-volume[76239]: INFO cinder.rpc [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 30 22:07:21 devstack cinder-volume[76239]: INFO cinder.rpc [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 30 22:07:21 devstack cinder-volume[76239]: DEBUG oslo_db.sqlalchemy.engines [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:07:21 devstack cinder-volume[76239]: INFO cinder.volume.manager [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Determined volume DB was empty at startup. Sep 30 22:07:21 devstack cinder-volume[76239]: DEBUG cinder.volume.manager [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76239) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 30 22:07:21 devstack cinder-volume[76239]: INFO cinder.volume.manager [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 30 22:07:21 devstack cinder-volume[76239]: WARNING stevedore.named [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 22:07:21 devstack cinder-volume[76239]: WARNING castellan.key_manager [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 22:07:21 devstack cinder-volume[76239]: WARNING cinder.keymgr.conf_key_mgr [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 22:07:21 devstack cinder-volume[76239]: DEBUG cinder.volume.drivers.lvm [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76239) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 30 22:07:21 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:21 devstack cinder-volume[76239]: DEBUG oslo_concurrency.processutils [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] CMD "cinder-rtstool verify" returned: 0 in 0.418s {{(pid=76239) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_db.sqlalchemy.engines [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:07:22 devstack cinder-volume[76239]: INFO cinder.rpc [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 30 22:07:22 devstack cinder-volume[76239]: INFO cinder.rpc [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 30 22:07:22 devstack cinder-volume[76239]: WARNING stevedore.named [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 22:07:22 devstack cinder-volume[76239]: WARNING castellan.key_manager [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 22:07:22 devstack cinder-volume[76239]: INFO cinder.volume.manager [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_db.sqlalchemy.engines [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76239) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:07:22 devstack cinder-volume[76239]: INFO oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Starting 1 workers Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Started child 76406 {{(pid=76239) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Full set of CONF: {{(pid=76239) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] ******************************************************************************** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Configuration options gathered from: {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] ================================================================================ {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] allow_availability_zone_fallback = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] allow_compression_on_image_upload = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] allowed_direct_url_schemes = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] api_rate_limit = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] auth_strategy = keystone {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] az_cache_duration = 3600 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_availability_zone = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_host = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_stats_polling_interval = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76406]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backup_api_class = cinder.backup.api.API {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backup_name_template = backup-%s {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backup_use_same_host = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backup_use_temp_snapshot = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] chap_password = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] chap_username = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cinder_internal_tenant_project_id = 6c613b7c0ef64dba8c537e467a77aa39 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cinder_internal_tenant_user_id = 6d7f96ce23494b8bb2e253a42fea7f20 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cloned_volume_same_az = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cluster = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] compression_format = gzip {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] compute_api_class = cinder.compute.nova.API {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] config_dir = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] config_source = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] control_exchange = openstack {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] debug = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] default_availability_zone = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] default_group_type = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] default_volume_type = lvmdriver-1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] disk_geometry = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] driver_client_cert = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] driver_client_cert_key = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] driver_data_namespace = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] driver_ssl_cert_path = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] driver_ssl_cert_verify = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] driver_use_ssl = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] enable_force_upload = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] enable_new_services = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] enable_unsupported_driver = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] enforce_multipath_for_image_xfer = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] filter_function = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_api_insecure = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_api_servers = ['http://192.168.122.40/image'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_api_ssl_compression = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_ca_certificates_file = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_catalog_info = image:glance:publicURL {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_certfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_keyfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_num_retries = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance_request_timeout = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] goodness_function = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] graceful_shutdown_timeout = 5 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] group_api_class = cinder.group.api.API {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] host = devstack {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_compress_on_upload = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_conversion_address_space_limit = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_conversion_cpu_limit = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_conversion_disable = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_introspection_address_space_limit = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_introspection_cpu_limit = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_upload_use_cinder_backend = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_upload_use_internal_tenant = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_volume_cache_enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_volume_cache_max_count = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] image_volume_cache_max_size_gb = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] init_host_max_objects_retrieval = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] instance_format = [instance: %(uuid)s] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] iscsi_target_flags = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] iscsi_write_cache = on {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] iser_helper = tgtadm {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] iser_ip_address = 192.168.122.40 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] iser_port = 3260 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] log_color = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] log_config_append = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] log_dir = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] log_file = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] log_options = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] log_rotate_interval = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] log_rotate_interval_type = days {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] log_rotation_type = none {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] max_age = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] max_logfile_count = 30 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76406]: INFO cinder.volume.manager [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 30 22:07:22 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] max_logfile_size_mb = 200 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] max_over_subscription_ratio = 20.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] message_reap_interval = 86400 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] message_ttl = 2592000 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] migration_create_volume_timeout_secs = 300 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] monkey_patch = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] monkey_patch_modules = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] my_ip = 192.168.122.40 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] no_snapshot_gb_quota = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] num_iser_scan_tries = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] num_shell_tries = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] num_volume_device_scan_tries = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] nvmeof_conn_info_version = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] nvmet_ns_id = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] nvmet_port_id = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] osapi_max_limit = 1000 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] osapi_volume_ext_list = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] osapi_volume_listen_port = 8776 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] osapi_volume_use_ssl = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] osapi_volume_workers = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] per_volume_size_limit = -1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] periodic_fuzzy_delay = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] periodic_interval = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] public_endpoint = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] publish_errors = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] quota_backup_gigabytes = 1000 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] quota_backups = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] quota_gigabytes = 1000 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] quota_groups = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] quota_snapshots = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] quota_volumes = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] rate_limit_burst = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] rate_limit_except_level = CRITICAL {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] rate_limit_interval = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] reinit_driver_count = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] replication_device = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] report_discard_supported = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] report_interval = 120 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] reservation_clean_interval = 86400 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] reservation_expire = 86400 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] reserved_image_namespaces = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] reserved_percentage = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] rpc_response_timeout = 120 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] run_external_periodic_tasks = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] scst_target_driver = iscsi {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] scst_target_iqn_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_down_time = 720 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] shell_completion = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] snapshot_name_template = snapshot-%s {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:22 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] snapshot_same_host = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] split_loggers = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] state_path = /opt/stack/data/cinder {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] storage_availability_zone = nova {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] storage_protocol = iSCSI {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] syslog_log_facility = LOG_USER {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] target_helper = lioadm {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] target_ip_address = 192.168.122.40 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] target_port = 3260 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] target_protocol = iscsi {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] target_secondary_ip_addresses = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] trace_flags = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] transport_url = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] until_refresh = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] use_chap_auth = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] use_default_quota_class = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] use_journal = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] use_json = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] use_multipath_for_image_xfer = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] use_stderr = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] use_syslog = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] verify_glance_signatures = enabled {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_api_class = cinder.volume.api.API {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_backend_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_clear = zero {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_clear_ionice = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_clear_size = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_copy_bps_limit = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_dd_blocksize = 1M {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_name_template = volume-%s {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_service_inithost_offload = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volume_usage_audit_period = month {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] zoning_mode = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_concurrency.disable_process_locking = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.auth_section = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.auth_type = password {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.auth_version = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.cache = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.certfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:22 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.include_service_catalog = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.insecure = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.interface = public {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.keyfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_password = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcache_username = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.region_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.service_type = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.40/identity {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.backend = dogpile.cache.null {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.backend_argument = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.backend_expiration_time = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.config_prefix = cache.oslo {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.debug_cache_backend = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.enable_retry_client = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.enable_socket_keepalive = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.expiration_time = 600 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.hashclient_retry_attempts = 2 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.memcache_dead_retry = 300 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.memcache_pool_maxsize = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.memcache_sasl_enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.password = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.proxies = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.redis_db = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.redis_server = localhost:6379 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.retry_attempts = 2 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.retry_delay = 0.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.socket_keepalive_count = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.socket_keepalive_idle = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.socket_keepalive_interval = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.socket_timeout = 1.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.tls_allowed_ciphers = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.tls_cafile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.tls_certfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.tls_enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.tls_keyfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cache.username = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] coordination.backend_url = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.asyncio_connection = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.asyncio_slave_connection = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.backend = sqlalchemy {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.connection = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.connection_debug = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.connection_parameters = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.connection_recycle_time = 3600 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.connection_trace = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.db_inc_retry_interval = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.db_max_retries = 20 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.db_max_retry_interval = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.db_retry_interval = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.max_overflow = 50 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.057s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:22 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.max_pool_size = 5 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.max_retries = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.mysql_wsrep_sync_wait = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.pool_timeout = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.retry_interval = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.slave_connection = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.sqlite_synchronous = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.synchronous_reader = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] database.use_db_reconnect = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_tracing.insecure = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.connection_string = messaging:// {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.es_doc_type = notification {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.es_scroll_size = 10000 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.es_scroll_time = 2m {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.filter_error_trace = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.hmac_keys = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.sentinel_service_name = mymaster {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.socket_timeout = 0.1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.trace_requests = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler.trace_sqlalchemy = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler_jaeger.process_tags = {} {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler_jaeger.service_name_prefix = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] profiler_otlp.service_name_prefix = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.enforce_new_defaults = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.policy_default_rule = default {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.policy_file = policy.yaml {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] privsep_osbrick.group = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] privsep_osbrick.helper_command = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] privsep_osbrick.user = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cinder_sys_admin.group = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cinder_sys_admin.helper_command = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] cinder_sys_admin.user = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.auth_section = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.auth_type = password {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.cafile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.certfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.collect_timing = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.insecure = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.keyfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.send_service_user_token = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.split_loggers = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.timeout = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.tls_ciphers = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] service_user.tls_min_version = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.auth_section = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.auth_type = password {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.certfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.collect_timing = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.insecure = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack sudo[76410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.keyfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.region_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack sudo[76410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.split_loggers = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.timeout = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.tls_ciphers = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] glance.tls_min_version = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.backend_availability_zone = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.chap_password = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.chap_username = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.disk_geometry = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.driver_client_cert = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.driver_client_cert_key = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.driver_data_namespace = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.driver_use_ssl = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.extra_capabilities = {} {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.filter_function = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.goodness_function = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.iscsi_target_flags = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.iscsi_write_cache = on {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.iser_helper = tgtadm {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.iser_ip_address = 192.168.122.40 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.iser_port = 3260 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.lvm_share_target = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.lvm_type = auto {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.num_shell_tries = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.replication_device = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.report_discard_supported = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.reserved_percentage = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.target_helper = tgtadm {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.target_ip_address = 192.168.122.40 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.target_port = 3260 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.target_protocol = iscsi {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.trace_flags = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.unique_fqdn_network = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.use_chap_auth = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volume_backend_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volume_clear = zero {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volume_clear_ionice = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volume_clear_size = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_reports.file_event_handler = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_reports.log_dir = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.backend_host = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.chap_password = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.chap_username = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.disk_geometry = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.driver_client_cert = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.extra_capabilities = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.filter_function = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.goodness_function = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.iser_helper = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.iser_ip_address = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.iser_port = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.lvm_share_target = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.lvm_type = auto {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.num_shell_tries = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.replication_device = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.report_discard_supported = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.reserved_percentage = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.scst_target_driver = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.storage_protocol = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.target_helper = lioadm {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.target_ip_address = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.target_port = 3260 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.trace_flags = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.use_chap_auth = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volume_clear = zero {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volume_clear_size = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] lvmdriver-1.volumes_dir = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.ssl = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_notifications.driver = [] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_notifications.retry = -1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] key_manager.fixed_key = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.barbican_api_version = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.barbican_endpoint = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.barbican_endpoint_type = public {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.barbican_region_name = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.cafile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.certfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.collect_timing = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.insecure = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.keyfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.number_of_retries = 60 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.retry_delay = 1 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.send_service_user_token = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.split_loggers = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.timeout = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.tls_ciphers = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.tls_min_version = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.verify_ssl = True {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican.verify_ssl_path = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.auth_section = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.auth_type = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.cafile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.certfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.collect_timing = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.insecure = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.keyfile = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.split_loggers = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.timeout = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.tls_ciphers = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] barbican_service_user.tls_min_version = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.approle_role_id = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.approle_secret_id = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.auth_method = approle {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.auth_path = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.kv_mountpoint = secret {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.kv_path = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.kv_version = 2 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.namespace = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.root_token_id = **** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.ssl_ca_crt_file = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.timeout = 60.0 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.token_file = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.token_role = None {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.use_ssl = False {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:07:22 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] ******************************************************************************** {{(pid=76239) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 30 22:07:22 devstack sudo[76410]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:22 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.376s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:22 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:22 devstack sudo[76519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:07:22 devstack sudo[76519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:23 devstack sudo[76519]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.327s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:07:23 devstack cinder-volume[76406]: INFO cinder.brick.local_dev.lvm [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:23 devstack sudo[76614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 22:07:23 devstack sudo[76614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:23 devstack sudo[76614]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG cinder.brick.local_dev.lvm [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76406) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:23 devstack sudo[76699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:07:23 devstack sudo[76699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:23 devstack sudo[76699]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.484s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:23 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:23 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:07:23 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:24 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:24 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:24 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:24 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:24 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:24 devstack sudo[76961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 30 22:07:24 devstack sudo[76961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:24 devstack sudo[76961]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:24 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.297s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:24 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:24 devstack sudo[77024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 22:07:24 devstack sudo[77024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:24 devstack sudo[77024]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:24 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:24 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:24 devstack sudo[77103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 22:07:24 devstack sudo[77103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:25 devstack sudo[77103]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:25 devstack sudo[77111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:07:25 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:25 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:25 devstack sudo[77132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:07:25 devstack sudo[77132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:25 devstack sudo[77132]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:25 devstack sudo[77204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:07:25 devstack sudo[77204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:25 devstack sudo[77204]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:25 devstack cinder-volume[76406]: INFO cinder.volume.drivers.lvm [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:25 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:25 devstack sudo[77208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:07:25 devstack sudo[77208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:26 devstack sudo[77208]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:26 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:26 devstack cinder-volume[76406]: DEBUG cinder.volume.drivers.lvm [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Updating volume stats {{(pid=76406) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 22:07:26 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:26 devstack sudo[77217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 22:07:26 devstack sudo[77217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:26 devstack sudo[77217]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:26 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:26 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:26 devstack sudo[77220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:07:26 devstack sudo[77220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:26 devstack sudo[77220]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:26 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:26 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:26 devstack sudo[77223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:07:26 devstack sudo[77223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:26 devstack sudo[77223]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:26 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:26 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:26 devstack sudo[77226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:07:26 devstack sudo[77226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:27 devstack sudo[77226]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:27 devstack cinder-volume[76406]: INFO cinder.volume.driver [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Driver hasn't implemented _init_vendor_properties() Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG cinder.volume.driver [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76406) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG oslo_db.sqlalchemy.engines [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG dbcounter [-] [76406] Writer thread running {{(pid=76406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG cinder.db.api [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Building query based on filter {{(pid=76406) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG cinder.image.image_utils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76406) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 30 22:07:27 devstack cinder-volume[76406]: INFO cinder.keymgr.migration [None req-43fe875d-65de-4df9-9abf-b41ff4ba050e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG cinder.volume.drivers.lvm [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Updating volume stats {{(pid=76406) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:27 devstack sudo[77229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 22:07:27 devstack sudo[77229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:27 devstack sudo[77229]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:27 devstack sudo[77233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:07:27 devstack sudo[77233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:27 devstack sudo[77233]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:27 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:27 devstack sudo[77237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:07:27 devstack sudo[77237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:28 devstack sudo[77237]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:28 devstack sudo[77240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:07:28 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:28 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG cinder.manager [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Notifying Schedulers of capabilities ... {{(pid=76406) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:07:28 devstack cinder-volume[76406]: INFO cinder.volume.manager [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Driver initialization completed successfully. Sep 30 22:07:28 devstack cinder-volume[76406]: INFO cinder.manager [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Initiating service 2 cleanup Sep 30 22:07:28 devstack cinder-volume[76406]: INFO cinder.manager [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Service 2 cleanup completed. Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG cinder.service [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Creating RPC server for service cinder-volume {{(pid=76406) start /opt/stack/cinder/cinder/service.py:231}} Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG cinder.service [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76406) start /opt/stack/cinder/cinder/service.py:237}} Sep 30 22:07:28 devstack cinder-volume[76406]: INFO cinder.volume.manager [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG cinder.volume.drivers.lvm [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Updating volume stats {{(pid=76406) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:28 devstack sudo[77244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 22:07:28 devstack sudo[77244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:28 devstack sudo[77244]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:28 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:28 devstack sudo[77247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:07:28 devstack sudo[77247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:29 devstack sudo[77247]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:29 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:29 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:29 devstack sudo[77252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:07:29 devstack sudo[77252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:29 devstack sudo[77252]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:29 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:29 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:07:29 devstack sudo[77259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:07:29 devstack sudo[77259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:07:29 devstack sudo[77259]: pam_unix(sudo:session): session closed for user root Sep 30 22:07:29 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:07:29 devstack cinder-volume[76406]: INFO cinder.volume.manager [None req-1a5d3ffc-a9f0-4a6f-b2ef-ae0ee3ac0e38 None None] Driver post RPC initialization completed successfully. Sep 30 22:07:32 devstack cinder-volume[76239]: DEBUG dbcounter [-] [76239] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76239) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:07:39 devstack cinder-volume[76406]: DEBUG dbcounter [-] [76406] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:07:39 devstack cinder-volume[76406]: DEBUG dbcounter [-] [76406] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:08:19 devstack cinder-volume[76406]: DEBUG oslo_service.periodic_task [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running periodic task VolumeManager._thread_info {{(pid=76406) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:08:19 devstack cinder-volume[76406]: DEBUG cinder.volume.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] thread count: 6 {{(pid=76406) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:08:19 devstack cinder-volume[76406]: DEBUG cinder.volume.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] thread info: [<_MainThread(MainThread, started 130749761855616)>, , , , , ] {{(pid=76406) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:09:19 devstack cinder-volume[76406]: DEBUG oslo_service.periodic_task [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76406) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:09:19 devstack cinder-volume[76406]: DEBUG cinder.volume.drivers.lvm [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Updating volume stats {{(pid=76406) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 22:09:19 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:09:19 devstack sudo[82407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 22:09:19 devstack sudo[82407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:09:19 devstack sudo[82407]: pam_unix(sudo:session): session closed for user root Sep 30 22:09:19 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:09:19 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:09:19 devstack sudo[82410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:09:19 devstack sudo[82410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:09:20 devstack sudo[82410]: pam_unix(sudo:session): session closed for user root Sep 30 22:09:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:09:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:09:20 devstack sudo[82414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:09:20 devstack sudo[82414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:09:20 devstack sudo[82414]: pam_unix(sudo:session): session closed for user root Sep 30 22:09:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:09:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:09:20 devstack sudo[82418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:09:20 devstack sudo[82418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:09:20 devstack sudo[82418]: pam_unix(sudo:session): session closed for user root Sep 30 22:09:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:09:20 devstack cinder-volume[76406]: DEBUG cinder.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Notifying Schedulers of capabilities ... {{(pid=76406) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:09:20 devstack cinder-volume[76406]: DEBUG oslo_service.periodic_task [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running periodic task VolumeManager._thread_info {{(pid=76406) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:09:20 devstack cinder-volume[76406]: DEBUG cinder.volume.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] thread count: 6 {{(pid=76406) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:09:20 devstack cinder-volume[76406]: DEBUG cinder.volume.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] thread info: [<_MainThread(MainThread, started 130749761855616)>, , , , , ] {{(pid=76406) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:09:39 devstack cinder-volume[76406]: DEBUG dbcounter [-] [76406] Writing DB stats cinder:SELECT=1 {{(pid=76406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:09:39 devstack cinder-volume[76406]: DEBUG dbcounter [-] [76406] Writing DB stats cinder:UPDATE=1 {{(pid=76406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:10:19 devstack cinder-volume[76406]: DEBUG oslo_service.periodic_task [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76406) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:10:19 devstack cinder-volume[76406]: DEBUG cinder.volume.drivers.lvm [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Updating volume stats {{(pid=76406) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 22:10:19 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:10:19 devstack sudo[84374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 22:10:19 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:10:19 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root Sep 30 22:10:19 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:10:19 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:10:19 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:10:19 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:10:20 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Sep 30 22:10:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:10:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:10:20 devstack sudo[84391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:10:20 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:10:20 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root Sep 30 22:10:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:10:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:10:20 devstack sudo[84399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:10:20 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:10:20 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root Sep 30 22:10:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:10:20 devstack cinder-volume[76406]: DEBUG cinder.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Notifying Schedulers of capabilities ... {{(pid=76406) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:10:20 devstack cinder-volume[76406]: DEBUG oslo_service.periodic_task [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running periodic task VolumeManager._thread_info {{(pid=76406) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:10:20 devstack cinder-volume[76406]: DEBUG cinder.volume.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] thread count: 6 {{(pid=76406) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:10:20 devstack cinder-volume[76406]: DEBUG cinder.volume.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] thread info: [<_MainThread(MainThread, started 130749761855616)>, , , , , ] {{(pid=76406) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:11:19 devstack cinder-volume[76406]: DEBUG oslo_service.periodic_task [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76406) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:11:19 devstack cinder-volume[76406]: DEBUG cinder.volume.drivers.lvm [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Updating volume stats {{(pid=76406) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 30 22:11:19 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:11:19 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 30 22:11:19 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:11:19 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Sep 30 22:11:19 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:11:19 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:11:19 devstack sudo[85717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:11:19 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:11:20 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root Sep 30 22:11:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:11:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:11:20 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 30 22:11:20 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:11:20 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Sep 30 22:11:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:11:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:11:20 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 30 22:11:20 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:11:20 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Sep 30 22:11:20 devstack cinder-volume[76406]: DEBUG oslo_concurrency.processutils [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:11:20 devstack cinder-volume[76406]: DEBUG cinder.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Notifying Schedulers of capabilities ... {{(pid=76406) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:11:20 devstack cinder-volume[76406]: DEBUG oslo_service.periodic_task [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] Running periodic task VolumeManager._thread_info {{(pid=76406) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:11:20 devstack cinder-volume[76406]: DEBUG cinder.volume.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] thread count: 6 {{(pid=76406) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:11:20 devstack cinder-volume[76406]: DEBUG cinder.volume.manager [None req-194e0ba4-12b4-4bb8-8757-bfdb95e81a54 None None] thread info: [<_MainThread(MainThread, started 130749761855616)>, , , , , ] {{(pid=76406) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:11:39 devstack cinder-volume[76406]: DEBUG dbcounter [-] [76406] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:11:48 devstack cinder-volume[76239]: INFO oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Caught SIGTERM, stopping children Sep 30 22:11:48 devstack cinder-volume[76239]: DEBUG oslo_concurrency.lockutils [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Acquiring lock "singleton_lock" {{(pid=76239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 22:11:48 devstack cinder-volume[76239]: DEBUG oslo_concurrency.lockutils [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Acquired lock "singleton_lock" {{(pid=76239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 22:11:48 devstack cinder-volume[76239]: DEBUG oslo_concurrency.lockutils [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Releasing lock "singleton_lock" {{(pid=76239) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 22:11:48 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Stop services. {{(pid=76239) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 30 22:11:48 devstack cinder-volume[76239]: DEBUG oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Killing children. {{(pid=76239) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 30 22:11:48 devstack cinder-volume[76239]: INFO oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Waiting on 1 children to exit Sep 30 22:11:53 devstack cinder-volume[76406]: DEBUG oslo_concurrency.lockutils [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Acquiring lock "singleton_lock" {{(pid=76406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 22:11:53 devstack cinder-volume[76406]: DEBUG oslo_concurrency.lockutils [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Acquired lock "singleton_lock" {{(pid=76406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 22:11:53 devstack cinder-volume[76406]: DEBUG oslo_concurrency.lockutils [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Releasing lock "singleton_lock" {{(pid=76406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 22:11:53 devstack cinder-volume[76406]: WARNING amqp [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 22:11:53 devstack cinder-volume[76406]: WARNING amqp [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 22:11:53 devstack cinder-volume[76239]: INFO oslo_service.backend._eventlet.service [None req-6b0fdaac-4fa1-4e5c-bd12-3d14a4fe3406 None None] Child 76406 exited with status 0 Sep 30 22:11:53 devstack cinder-volume[86360]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 30 22:11:53 devstack cinder-volume[86360]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 22:11:53 devstack cinder-volume[86360]: we strongly recommend against using it for new projects. Sep 30 22:11:53 devstack cinder-volume[86360]: If you are already using Eventlet, we recommend migrating to a different Sep 30 22:11:53 devstack cinder-volume[86360]: framework. For more detail see Sep 30 22:11:53 devstack cinder-volume[86360]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 22:11:53 devstack cinder-volume[86360]: import eventlet # noqa Sep 30 22:11:55 devstack cinder-volume[86360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86360) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 22:11:55 devstack cinder-volume[86360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86360) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 22:11:55 devstack cinder-volume[86360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86360) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 22:11:56 devstack cinder-volume[86360]: INFO dbcounter [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Registered counter for database cinder Sep 30 22:11:56 devstack cinder-volume[86360]: DEBUG oslo_db.sqlalchemy.engines [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86360) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:11:56 devstack cinder-volume[86360]: DEBUG dbcounter [-] [86360] Writer thread running {{(pid=86360) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 22:11:56 devstack cinder-volume[86360]: INFO cinder.rpc [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 30 22:11:56 devstack cinder-volume[86360]: INFO cinder.rpc [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_db.sqlalchemy.engines [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86360) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:11:57 devstack cinder-volume[86360]: INFO cinder.volume.manager [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Determined volume DB was empty at startup. Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG cinder.volume.manager [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86360) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 30 22:11:57 devstack cinder-volume[86360]: INFO cinder.volume.manager [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 30 22:11:57 devstack cinder-volume[86360]: WARNING stevedore.named [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 22:11:57 devstack cinder-volume[86360]: WARNING castellan.key_manager [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 22:11:57 devstack cinder-volume[86360]: WARNING cinder.keymgr.conf_key_mgr [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 22:11:57 devstack cinder-volume[86360]: INFO cinder.volume.manager [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_db.sqlalchemy.engines [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86360) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:11:57 devstack cinder-volume[86360]: INFO oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Starting 1 workers Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Started child 86575 {{(pid=86360) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Full set of CONF: {{(pid=86360) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] ******************************************************************************** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Configuration options gathered from: {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] ================================================================================ {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 30 22:11:57 devstack cinder-volume[86575]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] allow_availability_zone_fallback = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] allow_compression_on_image_upload = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] allowed_direct_url_schemes = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] api_rate_limit = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] auth_strategy = keystone {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_availability_zone = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_host = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_stats_polling_interval = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backup_api_class = cinder.backup.api.API {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backup_name_template = backup-%s {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backup_use_same_host = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backup_use_temp_snapshot = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] chap_password = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] chap_username = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cinder_internal_tenant_project_id = 6c613b7c0ef64dba8c537e467a77aa39 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cinder_internal_tenant_user_id = 6d7f96ce23494b8bb2e253a42fea7f20 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cluster = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] compression_format = gzip {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] compute_api_class = cinder.compute.nova.API {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] config_dir = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] config_source = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] control_exchange = openstack {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] debug = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] default_availability_zone = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] default_group_type = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] default_volume_type = QuobyteHD {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] disk_geometry = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] driver_client_cert = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] driver_client_cert_key = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] driver_data_namespace = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] driver_ssl_cert_path = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] driver_ssl_cert_verify = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] driver_use_ssl = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] enable_new_services = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] enable_unsupported_driver = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] enabled_backends = ['QuobyteHD'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] enforce_multipath_for_image_xfer = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] filter_function = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_api_insecure = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_api_servers = ['http://192.168.122.40/image'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_api_ssl_compression = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_ca_certificates_file = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_catalog_info = image:glance:publicURL {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_certfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_keyfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_num_retries = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance_request_timeout = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] goodness_function = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] graceful_shutdown_timeout = 5 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] group_api_class = cinder.group.api.API {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] host = devstack {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_compress_on_upload = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_conversion_address_space_limit = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_conversion_cpu_limit = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_conversion_disable = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_introspection_address_space_limit = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_introspection_cpu_limit = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_upload_use_cinder_backend = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_upload_use_internal_tenant = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_volume_cache_enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_volume_cache_max_count = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] image_volume_cache_max_size_gb = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] init_host_max_objects_retrieval = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] instance_format = [instance: %(uuid)s] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] iscsi_target_flags = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] iscsi_write_cache = on {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] iser_helper = tgtadm {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] iser_ip_address = 192.168.122.40 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] iser_port = 3260 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] log_color = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] log_config_append = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] log_dir = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] log_file = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] log_options = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] log_rotate_interval = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] log_rotate_interval_type = days {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] log_rotation_type = none {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] max_age = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] max_logfile_count = 30 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] max_logfile_size_mb = 200 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] max_over_subscription_ratio = 20.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] message_reap_interval = 86400 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] message_ttl = 2592000 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] migration_create_volume_timeout_secs = 300 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] monkey_patch = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] monkey_patch_modules = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] my_ip = 192.168.122.40 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86575]: INFO cinder.volume.manager [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Starting volume driver QuobyteDriver (1.2.1) Sep 30 22:11:57 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.remotefs [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86575) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] no_snapshot_gb_quota = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] num_iser_scan_tries = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] num_shell_tries = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] num_volume_device_scan_tries = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] nvmeof_conn_info_version = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] nvmet_ns_id = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] nvmet_port_id = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] osapi_max_limit = 1000 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] osapi_volume_ext_list = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] osapi_volume_listen_port = 8776 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] osapi_volume_use_ssl = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] osapi_volume_workers = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] per_volume_size_limit = -1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] periodic_fuzzy_delay = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] periodic_interval = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] public_endpoint = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] publish_errors = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] quota_backup_gigabytes = 1000 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] quota_backups = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] quota_gigabytes = 1000 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] quota_groups = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] quota_snapshots = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] quota_volumes = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] rate_limit_burst = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] rate_limit_except_level = CRITICAL {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] rate_limit_interval = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] reinit_driver_count = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] replication_device = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] report_discard_supported = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] report_interval = 120 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] reservation_clean_interval = 86400 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] reservation_expire = 86400 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] reserved_image_namespaces = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] reserved_percentage = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] rpc_response_timeout = 120 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] run_external_periodic_tasks = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] scst_target_driver = iscsi {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] scst_target_iqn_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_down_time = 720 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] shell_completion = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] snapshot_name_template = snapshot-%s {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] split_loggers = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] state_path = /opt/stack/data/cinder {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] storage_availability_zone = nova {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] storage_protocol = iSCSI {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] syslog_log_facility = LOG_USER {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] target_helper = lioadm {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] target_ip_address = 192.168.122.40 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] target_port = 3260 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] target_protocol = iscsi {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] target_secondary_ip_addresses = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] trace_flags = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] transport_url = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] until_refresh = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] use_chap_auth = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] use_default_quota_class = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] use_journal = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] use_json = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] use_multipath_for_image_xfer = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] use_stderr = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] use_syslog = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] verify_glance_signatures = enabled {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_api_class = cinder.volume.api.API {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_backend_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_clear = zero {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_clear_ionice = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_clear_size = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_copy_bps_limit = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_dd_blocksize = 1M {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_name_template = volume-%s {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_service_inithost_offload = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volume_usage_audit_period = month {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] zoning_mode = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_concurrency.disable_process_locking = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.auth_section = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.auth_type = password {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.auth_version = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.cache = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.certfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.include_service_catalog = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.insecure = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.interface = public {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.keyfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_password = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcache_username = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.region_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86575) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 30 22:11:57 devstack cinder-volume[86575]: WARNING cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 30 22:11:57 devstack cinder-volume[86575]: WARNING cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 30 22:11:57 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Running cmd (subprocess): mount.quobyte {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.service_type = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.40/identity {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.backend = dogpile.cache.null {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.backend_argument = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.backend_expiration_time = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.config_prefix = cache.oslo {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.debug_cache_backend = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.enable_retry_client = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.enable_socket_keepalive = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.expiration_time = 600 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.hashclient_retry_attempts = 2 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.memcache_dead_retry = 300 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.memcache_pool_maxsize = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.memcache_sasl_enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.password = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.proxies = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.redis_db = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.redis_server = localhost:6379 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.retry_attempts = 2 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.retry_delay = 0.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.socket_keepalive_count = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.socket_keepalive_idle = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.socket_keepalive_interval = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.socket_timeout = 1.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.tls_allowed_ciphers = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.tls_cafile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.tls_certfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.tls_enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.tls_keyfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cache.username = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] coordination.backend_url = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.asyncio_connection = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.asyncio_slave_connection = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.backend = sqlalchemy {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.connection = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.connection_debug = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.connection_parameters = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.connection_recycle_time = 3600 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.connection_trace = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.db_inc_retry_interval = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.db_max_retries = 20 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.db_max_retry_interval = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.db_retry_interval = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.max_overflow = 50 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.max_pool_size = 5 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.max_retries = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.mysql_wsrep_sync_wait = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.pool_timeout = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.retry_interval = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.slave_connection = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.sqlite_synchronous = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.synchronous_reader = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] database.use_db_reconnect = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_tracing.insecure = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.connection_string = messaging:// {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.es_doc_type = notification {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.es_scroll_size = 10000 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.es_scroll_time = 2m {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.filter_error_trace = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.hmac_keys = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.sentinel_service_name = mymaster {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.socket_timeout = 0.1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.trace_requests = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler.trace_sqlalchemy = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler_jaeger.process_tags = {} {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler_jaeger.service_name_prefix = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] profiler_otlp.service_name_prefix = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.enforce_new_defaults = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.policy_default_rule = default {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.policy_file = policy.yaml {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] privsep_osbrick.group = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] privsep_osbrick.helper_command = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] privsep_osbrick.user = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cinder_sys_admin.group = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cinder_sys_admin.helper_command = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] cinder_sys_admin.user = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.auth_section = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.auth_type = password {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.cafile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.certfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.collect_timing = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.insecure = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.keyfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.send_service_user_token = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.split_loggers = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.timeout = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.tls_ciphers = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] service_user.tls_min_version = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.auth_section = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.auth_type = password {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.certfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.collect_timing = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.insecure = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.keyfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.region_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.split_loggers = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.timeout = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.tls_ciphers = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] glance.tls_min_version = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.backend_availability_zone = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.chap_password = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.chap_username = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.disk_geometry = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.driver_client_cert = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.driver_client_cert_key = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.driver_data_namespace = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.driver_use_ssl = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.extra_capabilities = {} {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.filter_function = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.goodness_function = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.iscsi_target_flags = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.iscsi_write_cache = on {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.iser_helper = tgtadm {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.iser_ip_address = 192.168.122.40 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.iser_port = 3260 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_host = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_login = admin {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_mount_options = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_password = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack quobyte-client[86576]: Reading configuration file: /etc/quobyte/client.cfg Sep 30 22:11:57 devstack quobyte-client[86576]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_private_key = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_share_path = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.num_shell_tries = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] CMD "mount.quobyte" returned: 1 in 0.143s {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:11:57 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=86575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86575]: INFO cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 ... Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.quobyte_volume_url = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 -c /etc/quobyte/client-cinder.cfg {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.replication_device = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.report_discard_supported = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.reserved_percentage = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.target_helper = tgtadm {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.target_ip_address = 192.168.122.40 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.target_port = 3260 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.target_protocol = iscsi {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.trace_flags = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.unique_fqdn_network = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.use_chap_auth = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.volume_backend_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.volume_clear = zero {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.volume_clear_ionice = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.volume_clear_size = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_reports.file_event_handler = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_reports.log_dir = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.backend_availability_zone = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.backend_host = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.chap_password = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.chap_username = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.chiscsi_conf = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.disk_geometry = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.driver_client_cert = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 -c /etc/quobyte/client-cinder.cfg Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.driver_data_namespace = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.driver_use_ssl = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.extra_capabilities = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.filter_function = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.goodness_function = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.iser_helper = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.iser_ip_address = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.iser_port = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.iser_target_prefix = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_host = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_login = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_mount_options = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_password = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_private_key = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_share_path = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_ssh_port = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.num_shell_tries = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.nvmet_port_id = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.replication_device = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.report_discard_supported = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.reserved_percentage = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.scst_target_driver = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.storage_protocol = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.target_helper = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.target_ip_address = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.target_port = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.target_prefix = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.target_protocol = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.trace_flags = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.use_chap_auth = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.volume_clear = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.volume_clear_size = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] QuobyteHD.volumes_dir = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.ssl = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_notifications.driver = [] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_notifications.retry = -1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] key_manager.fixed_key = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.barbican_api_version = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.barbican_endpoint = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.barbican_endpoint_type = public {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.barbican_region_name = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.cafile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.certfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.collect_timing = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.insecure = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.keyfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.number_of_retries = 60 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.retry_delay = 1 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.send_service_user_token = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.split_loggers = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.timeout = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.tls_ciphers = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.tls_min_version = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.verify_ssl = True {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican.verify_ssl_path = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.auth_section = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.auth_type = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.cafile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.certfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.collect_timing = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.insecure = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.keyfile = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.split_loggers = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.timeout = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.tls_ciphers = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] barbican_service_user.tls_min_version = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.approle_role_id = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.approle_secret_id = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.auth_method = approle {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.auth_path = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.kv_mountpoint = secret {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.kv_path = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.kv_version = 2 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.namespace = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.root_token_id = **** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.ssl_ca_crt_file = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.timeout = 60.0 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.token_file = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.token_role = None {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.use_ssl = False {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:11:57 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] ******************************************************************************** {{(pid=86360) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 30 22:11:58 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.396s {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:11:58 devstack cinder-volume[86575]: INFO cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 succeeded Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=86575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.408s {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:11:58 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:11:58 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:11:58 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.237s {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:11:58 devstack cinder-volume[86575]: INFO cinder.volume.driver [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Driver hasn't implemented _init_vendor_properties() Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.volume.driver [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.893783569336, 'free_capacity_gb': 1774.893783569336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86575) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_db.sqlalchemy.engines [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86575) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG dbcounter [-] [86575] Writer thread running {{(pid=86575) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.db.api [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Building query based on filter {{(pid=86575) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.image.image_utils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86575) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 30 22:11:58 devstack cinder-volume[86575]: INFO cinder.keymgr.migration [None req-93de5534-f0e3-4b80-9d19-d8d837ee9a32 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=86575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=86575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:11:58 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:11:58 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:11:58 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.230s {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.manager [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Notifying Schedulers of capabilities ... {{(pid=86575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:11:58 devstack cinder-volume[86575]: INFO cinder.volume.manager [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Driver initialization completed successfully. Sep 30 22:11:58 devstack cinder-volume[86575]: INFO cinder.manager [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Initiating service 3 cleanup Sep 30 22:11:58 devstack cinder-volume[86575]: INFO cinder.manager [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Service 3 cleanup completed. Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.service [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Creating RPC server for service cinder-volume {{(pid=86575) start /opt/stack/cinder/cinder/service.py:231}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.service [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86575) start /opt/stack/cinder/cinder/service.py:237}} Sep 30 22:11:58 devstack cinder-volume[86575]: INFO cinder.volume.manager [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=86575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.quobyte [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=86575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:11:58 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:11:58 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:11:58 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:11:59 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Sep 30 22:11:59 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.244s {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:11:59 devstack cinder-volume[86575]: INFO cinder.volume.manager [None req-0960a9aa-ce43-4e11-8fdb-e0477e4a301a None None] Driver post RPC initialization completed successfully. Sep 30 22:12:03 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-66b2da93-a652-4802-adf4-116663113490 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:12:03 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-66b2da93-a652-4802-adf4-116663113490 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:12:03 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.quobyte [None req-66b2da93-a652-4802-adf4-116663113490 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=86575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:12:03 devstack cinder-volume[86575]: DEBUG cinder.volume.drivers.quobyte [None req-66b2da93-a652-4802-adf4-116663113490 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=86575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:12:03 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-66b2da93-a652-4802-adf4-116663113490 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86575) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:12:03 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-66b2da93-a652-4802-adf4-116663113490 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:12:03 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:12:03 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:12:03 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Sep 30 22:12:03 devstack cinder-volume[86575]: DEBUG oslo_concurrency.processutils [None req-66b2da93-a652-4802-adf4-116663113490 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.239s {{(pid=86575) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:12:03 devstack cinder-volume[86575]: DEBUG cinder.manager [None req-66b2da93-a652-4802-adf4-116663113490 None None] Notifying Schedulers of capabilities ... {{(pid=86575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:12:04 devstack cinder-volume[86360]: INFO oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Caught SIGTERM, stopping children Sep 30 22:12:04 devstack cinder-volume[86360]: DEBUG oslo_concurrency.lockutils [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Acquiring lock "singleton_lock" {{(pid=86360) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 22:12:04 devstack cinder-volume[86360]: DEBUG oslo_concurrency.lockutils [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Acquired lock "singleton_lock" {{(pid=86360) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 22:12:04 devstack cinder-volume[86360]: DEBUG oslo_concurrency.lockutils [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Releasing lock "singleton_lock" {{(pid=86360) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 22:12:04 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Stop services. {{(pid=86360) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 30 22:12:04 devstack cinder-volume[86360]: DEBUG oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Killing children. {{(pid=86360) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 30 22:12:04 devstack cinder-volume[86360]: INFO oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Waiting on 1 children to exit Sep 30 22:12:07 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Acquiring lock "singleton_lock" {{(pid=86575) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 22:12:07 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Acquired lock "singleton_lock" {{(pid=86575) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 22:12:07 devstack cinder-volume[86575]: DEBUG oslo_concurrency.lockutils [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Releasing lock "singleton_lock" {{(pid=86575) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 22:12:07 devstack cinder-volume[86575]: WARNING amqp [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 22:12:07 devstack cinder-volume[86575]: WARNING amqp [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 30 22:12:07 devstack cinder-volume[86360]: INFO oslo_service.backend._eventlet.service [None req-2c00715a-2fbe-4343-987f-031441658b23 None None] Child 86575 exited with status 0 Sep 30 22:12:07 devstack cinder-volume[86907]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 30 22:12:07 devstack cinder-volume[86907]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 22:12:07 devstack cinder-volume[86907]: we strongly recommend against using it for new projects. Sep 30 22:12:07 devstack cinder-volume[86907]: If you are already using Eventlet, we recommend migrating to a different Sep 30 22:12:07 devstack cinder-volume[86907]: framework. For more detail see Sep 30 22:12:07 devstack cinder-volume[86907]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 22:12:07 devstack cinder-volume[86907]: import eventlet # noqa Sep 30 22:12:11 devstack cinder-volume[86907]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86907) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 30 22:12:11 devstack cinder-volume[86907]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86907) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 30 22:12:11 devstack cinder-volume[86907]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86907) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 30 22:12:12 devstack cinder-volume[86907]: INFO dbcounter [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Registered counter for database cinder Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_db.sqlalchemy.engines [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86907) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG dbcounter [-] [86907] Writer thread running {{(pid=86907) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 22:12:12 devstack cinder-volume[86907]: INFO cinder.rpc [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 30 22:12:12 devstack cinder-volume[86907]: INFO cinder.rpc [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_db.sqlalchemy.engines [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86907) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:12:12 devstack cinder-volume[86907]: INFO cinder.volume.manager [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Determined volume DB was empty at startup. Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG cinder.volume.manager [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86907) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 30 22:12:12 devstack cinder-volume[86907]: WARNING stevedore.named [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 30 22:12:12 devstack cinder-volume[86907]: WARNING castellan.key_manager [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 22:12:12 devstack cinder-volume[86907]: WARNING cinder.keymgr.conf_key_mgr [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 30 22:12:12 devstack cinder-volume[86907]: INFO cinder.volume.manager [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_db.sqlalchemy.engines [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86907) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:12:12 devstack cinder-volume[86907]: INFO oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Starting 1 workers Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Started child 87240 {{(pid=86907) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Full set of CONF: {{(pid=86907) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] ******************************************************************************** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] Configuration options gathered from: {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 30 22:12:12 devstack cinder-volume[87240]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] ================================================================================ {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] allow_availability_zone_fallback = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] allow_compression_on_image_upload = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] allowed_direct_url_schemes = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] api_rate_limit = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] auth_strategy = keystone {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_availability_zone = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_host = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_stats_polling_interval = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backup_api_class = cinder.backup.api.API {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backup_name_template = backup-%s {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backup_use_same_host = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backup_use_temp_snapshot = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] chap_password = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] chap_username = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cinder_internal_tenant_project_id = 6c613b7c0ef64dba8c537e467a77aa39 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cinder_internal_tenant_user_id = 6d7f96ce23494b8bb2e253a42fea7f20 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cluster = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] compression_format = gzip {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] compute_api_class = cinder.compute.nova.API {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] config_dir = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] config_source = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] control_exchange = openstack {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] debug = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] default_availability_zone = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] default_group_type = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] default_volume_type = QuobyteHD {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] disk_geometry = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] driver_client_cert = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] driver_client_cert_key = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] driver_data_namespace = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] driver_ssl_cert_path = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] driver_ssl_cert_verify = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] driver_use_ssl = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] enable_new_services = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] enable_unsupported_driver = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] enabled_backends = ['QuobyteHD'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] enforce_multipath_for_image_xfer = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] filter_function = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_api_insecure = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_api_servers = ['http://192.168.122.40/image'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_api_ssl_compression = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_ca_certificates_file = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_catalog_info = image:glance:publicURL {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_certfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_keyfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_num_retries = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance_request_timeout = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] goodness_function = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] graceful_shutdown_timeout = 5 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] group_api_class = cinder.group.api.API {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] host = devstack {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_compress_on_upload = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_conversion_address_space_limit = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_conversion_cpu_limit = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_conversion_disable = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_introspection_address_space_limit = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_introspection_cpu_limit = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_upload_use_cinder_backend = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_upload_use_internal_tenant = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_volume_cache_enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_volume_cache_max_count = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] image_volume_cache_max_size_gb = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] init_host_max_objects_retrieval = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] instance_format = [instance: %(uuid)s] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] iscsi_target_flags = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] iscsi_write_cache = on {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87240) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] iser_helper = tgtadm {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] iser_ip_address = 192.168.122.40 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] iser_port = 3260 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] log_color = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] log_config_append = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] log_dir = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] log_file = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] log_options = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] log_rotate_interval = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] log_rotate_interval_type = days {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] log_rotation_type = none {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] max_age = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] max_logfile_count = 30 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] max_logfile_size_mb = 200 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] max_over_subscription_ratio = 20.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] message_reap_interval = 86400 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] message_ttl = 2592000 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] migration_create_volume_timeout_secs = 300 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] monkey_patch = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] monkey_patch_modules = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] my_ip = 192.168.122.40 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] no_snapshot_gb_quota = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] num_iser_scan_tries = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] num_shell_tries = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] num_volume_device_scan_tries = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] nvmeof_conn_info_version = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] nvmet_ns_id = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] nvmet_port_id = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] osapi_max_limit = 1000 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] osapi_volume_ext_list = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] osapi_volume_listen = 0.0.0.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] osapi_volume_listen_port = 8776 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] osapi_volume_use_ssl = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] osapi_volume_workers = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] per_volume_size_limit = -1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] periodic_fuzzy_delay = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] periodic_interval = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] project_id_regex = [0-9a-f\-]+ {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] public_endpoint = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] publish_errors = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] quota_backup_gigabytes = 1000 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] quota_backups = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] quota_gigabytes = 1000 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] quota_groups = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] quota_snapshots = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] quota_volumes = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] rate_limit_burst = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] rate_limit_except_level = CRITICAL {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] rate_limit_interval = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] reinit_driver_count = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] replication_device = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] report_discard_supported = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] report_interval = 120 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] reservation_clean_interval = 86400 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] reservation_expire = 86400 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] reserved_image_namespaces = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] reserved_percentage = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] rpc_response_timeout = 120 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] run_external_periodic_tasks = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] scst_target_driver = iscsi {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] scst_target_iqn_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_down_time = 720 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] shell_completion = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] snapshot_name_template = snapshot-%s {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] split_loggers = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] state_path = /opt/stack/data/cinder {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] storage_availability_zone = nova {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] storage_protocol = iSCSI {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] syslog_log_facility = LOG_USER {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] target_helper = lioadm {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] target_ip_address = 192.168.122.40 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] target_port = 3260 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] target_protocol = iscsi {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] target_secondary_ip_addresses = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] trace_flags = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] transfer_api_class = cinder.transfer.api.API {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] transport_url = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] until_refresh = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] use_chap_auth = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] use_default_quota_class = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] use_journal = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] use_json = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] use_multipath_for_image_xfer = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] use_stderr = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] use_syslog = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] verify_glance_signatures = enabled {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_api_class = cinder.volume.api.API {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_backend_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_clear = zero {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_clear_ionice = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_clear_size = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_copy_bps_limit = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_dd_blocksize = 1M {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_name_template = volume-%s {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_service_inithost_offload = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volume_usage_audit_period = month {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] zoning_mode = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_concurrency.disable_process_locking = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87240) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.quobyte [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.quobyte [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Running cmd (subprocess): mount.quobyte {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.auth_section = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.auth_type = password {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.auth_version = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.cache = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.certfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.delay_auth_decision = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.http_connect_timeout = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.include_service_catalog = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.insecure = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.interface = public {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.keyfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_password = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcache_username = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.region_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.service_token_roles_required = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.service_type = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.token_cache_time = 300 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.40/identity {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.backend = dogpile.cache.null {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.backend_argument = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.backend_expiration_time = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.config_prefix = cache.oslo {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.debug_cache_backend = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.enable_retry_client = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.enable_socket_keepalive = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.expiration_time = 600 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.hashclient_retry_attempts = 2 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.memcache_dead_retry = 300 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.memcache_pool_maxsize = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.memcache_sasl_enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.password = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.proxies = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.redis_db = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.redis_sentinel_service_name = mymaster {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.redis_server = localhost:6379 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.retry_attempts = 2 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.retry_delay = 0.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.socket_keepalive_count = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.socket_keepalive_idle = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.socket_keepalive_interval = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.socket_timeout = 1.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.tls_allowed_ciphers = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.tls_cafile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:12 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.tls_certfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.tls_enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.tls_keyfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cache.username = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] coordination.backend_url = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.asyncio_connection = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.asyncio_slave_connection = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.backend = sqlalchemy {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.connection = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.connection_debug = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.connection_parameters = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.connection_recycle_time = 3600 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.connection_trace = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.db_inc_retry_interval = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.db_max_retries = 20 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.db_max_retry_interval = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.db_retry_interval = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.max_overflow = 50 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.max_pool_size = 5 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.max_retries = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.mysql_wsrep_sync_wait = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.pool_timeout = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.retry_interval = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.slave_connection = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.sqlite_synchronous = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.synchronous_reader = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] database.use_db_reconnect = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_tracing.insecure = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.connection_string = messaging:// {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.es_doc_type = notification {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.es_scroll_size = 10000 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.es_scroll_time = 2m {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.filter_error_trace = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.hmac_keys = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.sentinel_service_name = mymaster {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.socket_timeout = 0.1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.trace_requests = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler.trace_sqlalchemy = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler_jaeger.process_tags = {} {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler_jaeger.service_name_prefix = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] profiler_otlp.service_name_prefix = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.enforce_new_defaults = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.policy_default_rule = default {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.policy_file = policy.yaml {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_policy.remote_timeout = 60.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] privsep_osbrick.group = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] privsep_osbrick.helper_command = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] privsep_osbrick.user = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cinder_sys_admin.group = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cinder_sys_admin.helper_command = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack quobyte-client[87241]: Reading configuration file: /etc/quobyte/client.cfg Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] cinder_sys_admin.user = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.auth_section = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.auth_type = password {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.cafile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.certfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.collect_timing = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack quobyte-client[87241]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.insecure = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.keyfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.send_service_user_token = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.split_loggers = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.timeout = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.tls_ciphers = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] service_user.tls_min_version = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.auth_section = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.auth_type = password {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.certfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.collect_timing = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.insecure = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.keyfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.region_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.split_loggers = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.timeout = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.tls_ciphers = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] glance.tls_min_version = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.backend_availability_zone = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.chap_password = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.chap_username = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.disk_geometry = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.driver_client_cert = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.driver_client_cert_key = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.driver_data_namespace = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.driver_use_ssl = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.enable_unsupported_driver = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.extra_capabilities = {} {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.filter_function = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.goodness_function = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.iscsi_target_flags = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.iscsi_write_cache = on {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.iser_helper = tgtadm {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.iser_ip_address = 192.168.122.40 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.iser_port = 3260 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_host = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_login = admin {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_mount_options = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_password = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_private_key = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_share_path = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_ssh_port = 22 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.num_shell_tries = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.nvmet_port_id = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.quobyte_client_cfg = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.quobyte_volume_url = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.replication_device = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.report_discard_supported = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.reserved_percentage = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.scst_target_driver = iscsi {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.scst_target_iqn_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.storage_protocol = iSCSI {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.target_helper = tgtadm {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.target_ip_address = 192.168.122.40 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.target_port = 3260 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.target_protocol = iscsi {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.trace_flags = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.unique_fqdn_network = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.use_chap_auth = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.volume_backend_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.volume_clear = zero {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.volume_clear_ionice = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.volume_clear_size = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_reports.file_event_handler = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_reports.log_dir = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.backend_availability_zone = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.backend_host = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.chap_password = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.chap_username = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.chiscsi_conf = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.disk_geometry = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.driver_client_cert = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.driver_client_cert_key = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.driver_data_namespace = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.driver_use_ssl = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.extra_capabilities = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.filter_function = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.goodness_function = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.iscsi_target_flags = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.iscsi_write_cache = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.iser_helper = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.iser_ip_address = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.iser_port = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.iser_target_prefix = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_host = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_login = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_mount_options = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_password = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_private_key = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_share_path = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_ssh_port = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.num_shell_tries = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nvmet_ns_id = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.nvmet_port_id = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.replication_device = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.report_discard_supported = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.reserved_percentage = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.scst_target_driver = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.storage_protocol = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.target_helper = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.target_ip_address = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.target_port = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.target_prefix = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.target_protocol = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.trace_flags = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.unique_fqdn_network = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.use_chap_auth = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.volume_clear = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.volume_clear_ionice = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.volume_clear_size = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] QuobyteHD.volumes_dir = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.ssl = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.ssl_version = {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_notifications.driver = [] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_notifications.retry = -1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] oslo_messaging_notifications.transport_url = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] key_manager.fixed_key = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.barbican_api_version = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.barbican_endpoint = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.barbican_endpoint_type = public {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.barbican_region_name = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.cafile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.certfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.collect_timing = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.insecure = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.keyfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.number_of_retries = 60 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.retry_delay = 1 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.send_service_user_token = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.split_loggers = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.timeout = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.tls_ciphers = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.tls_min_version = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.verify_ssl = True {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican.verify_ssl_path = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.auth_section = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.auth_type = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.cafile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.certfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.collect_timing = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.insecure = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.keyfile = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.split_loggers = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.timeout = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.tls_ciphers = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] barbican_service_user.tls_min_version = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.approle_role_id = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.approle_secret_id = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.auth_method = approle {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.auth_path = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.kv_mountpoint = secret {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.kv_path = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.kv_version = 2 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.namespace = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.root_token_id = **** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.ssl_ca_crt_file = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.timeout = 60.0 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.token_file = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.token_role = None {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.use_ssl = False {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 30 22:12:13 devstack cinder-volume[86907]: DEBUG oslo_service.backend._eventlet.service [None req-1738c017-226c-4b97-b8a0-7d8579d6e5de None None] ******************************************************************************** {{(pid=86907) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 30 22:12:13 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.277s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:12:13 devstack cinder-volume[87240]: INFO cinder.volume.driver [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Driver hasn't implemented _init_vendor_properties() Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.volume.driver [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.893783569336, 'free_capacity_gb': 1774.893783569336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87240) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_db.sqlalchemy.engines [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writer thread running {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.db.api [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Building query based on filter {{(pid=87240) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87240) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:12:13 devstack cinder-volume[87240]: INFO cinder.keymgr.migration [None req-c287aefa-23f4-44e0-a715-336dcfbd0b4e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 30 22:12:13 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:12:13 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:12:13 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.229s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:12:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Driver initialization completed successfully. Sep 30 22:12:13 devstack cinder-volume[87240]: INFO cinder.manager [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Initiating service 3 cleanup Sep 30 22:12:13 devstack cinder-volume[87240]: INFO cinder.manager [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Service 3 cleanup completed. Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.service [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Creating RPC server for service cinder-volume {{(pid=87240) start /opt/stack/cinder/cinder/service.py:231}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.service [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87240) start /opt/stack/cinder/cinder/service.py:237}} Sep 30 22:12:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:12:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:12:13 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:12:13 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:12:14 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Sep 30 22:12:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.233s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:12:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bf6f1450-10f5-4ff5-b2ec-3d2c5920b10c None None] Driver post RPC initialization completed successfully. Sep 30 22:12:22 devstack cinder-volume[86907]: DEBUG dbcounter [-] [86907] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86907) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:12:23 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:12:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:13:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:13:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 6 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:13:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Flow 'volume_create_manager' (06966917-cdc4-4774-a1b7-af03eef1bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1606ab2-697d-4f2f-8402-d15b88301668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1606ab2-697d-4f2f-8402-d15b88301668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1350322374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8fd900-3617-4d35-a264-8336f62cdd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b30e32e8ae074b6594dc5e8bf4120838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:13:23Z,use_quota=True,user_id='fd35b58a08ae464185ce887bab0e48f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183d4d60-252d-40fc-9cb1-c3fd3d97103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183d4d60-252d-40fc-9cb1-c3fd3d97103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038acd52-946c-490e-8498-2a60b81de7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038acd52-946c-490e-8498-2a60b81de7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8fd900-3617-4d35-a264-8336f62cdd00', 'volume_name': 'volume-ea8fd900-3617-4d35-a264-8336f62cdd00', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4146433-2b20-49f7-ba6c-ef02f729b3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4146433-2b20-49f7-ba6c-ef02f729b3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3065ac-8414-47a2-8da3-0b776b608063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:23 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Volume ea8fd900-3617-4d35-a264-8336f62cdd00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8fd900-3617-4d35-a264-8336f62cdd00', 'volume_size': 1} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1350322374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8fd900-3617-4d35-a264-8336f62cdd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b30e32e8ae074b6594dc5e8bf4120838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:13:23Z,use_quota=True,user_id='fd35b58a08ae464185ce887bab0e48f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Creating volume ea8fd900-3617-4d35-a264-8336f62cdd00 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:13:23 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:13:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:23 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00 1073741824 Sep 30 22:13:23 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:24 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00 1073741824" returned: 0 in 1.347s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:25 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00 Sep 30 22:13:25 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:25 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00" returned: 0 in 0.471s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:13:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3065ac-8414-47a2-8da3-0b776b608063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8fd900-3617-4d35-a264-8336f62cdd00', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43fa2f4-728e-45c5-acc2-1422a207055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Volume volume-ea8fd900-3617-4d35-a264-8336f62cdd00 (ea8fd900-3617-4d35-a264-8336f62cdd00): created successfully Sep 30 22:13:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43fa2f4-728e-45c5-acc2-1422a207055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Flow 'volume_create_manager' (06966917-cdc4-4774-a1b7-af03eef1bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:13:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0c909462-c853-43c2-bf2e-71244f583ff8 tempest-DeleteServersTestJSON-676454735 None] Created volume successfully. Sep 30 22:13:30 devstack cinder-volume[87240]: WARNING py.warnings [req-2b446ad4-f489-4e1f-b79d-72e68cbf5923 req-9314f38f-0e0b-40a2-91c6-7cc4850add0c tempest-DeleteServersTestJSON-676454735 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 30 22:13:30 devstack cinder-volume[87240]: .first() Sep 30 22:13:30 devstack cinder-volume[87240]: Sep 30 22:13:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2b446ad4-f489-4e1f-b79d-72e68cbf5923 req-9314f38f-0e0b-40a2-91c6-7cc4850add0c tempest-DeleteServersTestJSON-676454735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2b446ad4-f489-4e1f-b79d-72e68cbf5923 req-9314f38f-0e0b-40a2-91c6-7cc4850add0c tempest-DeleteServersTestJSON-676454735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2b446ad4-f489-4e1f-b79d-72e68cbf5923 req-9314f38f-0e0b-40a2-91c6-7cc4850add0c tempest-DeleteServersTestJSON-676454735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-2b446ad4-f489-4e1f-b79d-72e68cbf5923 req-9314f38f-0e0b-40a2-91c6-7cc4850add0c tempest-DeleteServersTestJSON-676454735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-ea8fd900-3617-4d35-a264-8336f62cdd00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70d3375b-f260-4cb7-ac57-8153299b86a7', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:13:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-2b446ad4-f489-4e1f-b79d-72e68cbf5923 req-9314f38f-0e0b-40a2-91c6-7cc4850add0c tempest-DeleteServersTestJSON-676454735 None] attachment_update completed successfully. Sep 30 22:13:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-ab54f9c0-ddcf-4e33-a696-fcccc04ee546 req-5c92e92c-9ef8-4eb1-8e14-98ce5e0d4fb0 tempest-DeleteServersTestJSON-676454735 None] Terminate volume connection completed successfully. Sep 30 22:13:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-ab54f9c0-ddcf-4e33-a696-fcccc04ee546 req-5c92e92c-9ef8-4eb1-8e14-98ce5e0d4fb0 tempest-DeleteServersTestJSON-676454735 None] Deleting attachment 70d3375b-f260-4cb7-ac57-8153299b86a7. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Flow 'volume_create_manager' (3b124eaa-e721-49c2-824d-4245e65ee8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a58a81-fefc-4c72-8e63-13d36808e7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a58a81-fefc-4c72-8e63-13d36808e7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1908177603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3af10f-5937-4cc1-950e-f04d7fde6a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003ae97e7d254d7c991a1b9e23cc5cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:13:41Z,use_quota=True,user_id='56d8eead126f4a999a290d243abb1883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfd17c1-2451-4694-ad91-274cbbd3e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfd17c1-2451-4694-ad91-274cbbd3e16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fbe290-9a66-46d6-885c-87b545b7f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fbe290-9a66-46d6-885c-87b545b7f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3af10f-5937-4cc1-950e-f04d7fde6a87', 'volume_name': 'volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97e3b5a-3dcc-40f6-b19c-5fc821d12f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97e3b5a-3dcc-40f6-b19c-5fc821d12f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fd63b7-7cc4-4901-bb84-15d9bc873ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Volume 5b3af10f-5937-4cc1-950e-f04d7fde6a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87', 'volume_size': 1} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1908177603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3af10f-5937-4cc1-950e-f04d7fde6a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003ae97e7d254d7c991a1b9e23cc5cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:13:41Z,use_quota=True,user_id='56d8eead126f4a999a290d243abb1883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Creating volume 5b3af10f-5937-4cc1-950e-f04d7fde6a87 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:13:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:13:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:41 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 1073741824 Sep 30 22:13:41 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Acquiring lock "cinder-ea8fd900-3617-4d35-a264-8336f62cdd00-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:13:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Lock "cinder-ea8fd900-3617-4d35-a264-8336f62cdd00-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:13:41 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Acquiring lock "cinder-quobyte-ea8fd900-3617-4d35-a264-8336f62cdd00" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:13:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 1073741824" returned: 0 in 0.970s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Lock "cinder-quobyte-ea8fd900-3617-4d35-a264-8336f62cdd00" acquired by "delete_volume" :: waited 0.056s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:13:42 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0uoe58l5/privsep.sock'] Sep 30 22:13:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:42 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0uoe58l5/privsep.sock Sep 30 22:13:42 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:42 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 Sep 30 22:13:42 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:42 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87" returned: 0 in 0.410s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:13:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fd63b7-7cc4-4901-bb84-15d9bc873ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732656be-76a6-45b4-8c30-5a227a53503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Volume volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 (5b3af10f-5937-4cc1-950e-f04d7fde6a87): created successfully Sep 30 22:13:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (732656be-76a6-45b4-8c30-5a227a53503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Flow 'volume_create_manager' (3b124eaa-e721-49c2-824d-4245e65ee8c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:13:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dca5af9f-1e1e-4f78-9fff-6c82ad45d5ce tempest-VolumesAdminNegativeTest-1482813188 None] Created volume successfully. Sep 30 22:13:43 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 30 22:13:43 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 30 22:13:43 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 30 22:13:43 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: Sep 30 22:13:43 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 30 22:13:43 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 30 22:13:43 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 30 22:13:43 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: Sep 30 22:13:43 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 30 22:13:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Acquiring lock "cinder-5b3af10f-5937-4cc1-950e-f04d7fde6a87-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:13:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Lock "cinder-5b3af10f-5937-4cc1-950e-f04d7fde6a87-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:13:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Acquiring lock "cinder-quobyte-5b3af10f-5937-4cc1-950e-f04d7fde6a87" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:13:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Lock "cinder-quobyte-5b3af10f-5937-4cc1-950e-f04d7fde6a87" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:13:44 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:44 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Spawned new privsep daemon via rootwrap Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Accepted privsep connection to /tmp/tmp0uoe58l5/privsep.sock {{(pid=87240) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 30 22:13:44 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 30 22:13:44 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 30 22:13:44 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 30 22:13:44 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89111 Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[840db693-b8d2-405b-adeb-8de8a2109983]: (2,) {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:13:44 devstack cinder-volume[87240]: WARNING oslo_privsep.priv_context [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] privsep daemon already running Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43e992a-e169-4eca-ba45-7477ba733978]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee09b8a-cca7-4c6e-a531-43333015cfd0]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:44 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00 Sep 30 22:13:44 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:44 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 Sep 30 22:13:44 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:44 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00" returned: 0 in 0.646s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:44 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87" returned: 0 in 0.650s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:44 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00 Sep 30 22:13:44 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:44 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87 Sep 30 22:13:44 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:45 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ea8fd900-3617-4d35-a264-8336f62cdd00" returned: 0 in 0.445s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Lock "cinder-quobyte-ea8fd900-3617-4d35-a264-8336f62cdd00" released by "delete_volume" :: held 3.285s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:13:45 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5b3af10f-5937-4cc1-950e-f04d7fde6a87" returned: 0 in 0.537s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:45 devstack cinder-volume[87240]: WARNING cinder.quota [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:13:45 devstack cinder-volume[87240]: WARNING cinder.quota [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Lock "cinder-quobyte-5b3af10f-5937-4cc1-950e-f04d7fde6a87" released by "delete_volume" :: held 1.486s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Created reservations ['46f7f9b5-3666-4287-b650-80510b632710', 'bf7f1614-5bcb-47e4-b355-33368046cfa5', 'bd76894b-ad62-49f7-a7a1-5d7cf9e457cf', '92215fd4-a7ba-4dec-8aef-dc45ad0ae103'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Flow 'volume_create_manager' (0d0d0f08-0cb8-4dc0-891f-d034604f439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712e08f5-daa7-4543-9380-48dccaaea125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712e08f5-daa7-4543-9380-48dccaaea125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1660681486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281d0bad-294d-460d-8415-676c4c775a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace5d4dbb14c4367839f80480b2370c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:13:46Z,use_quota=True,user_id='38a6a87e385f40749fd657d193a385f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f6bc11-ad96-4035-b8e6-d4e753ea17a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f6bc11-ad96-4035-b8e6-d4e753ea17a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c27220-21b8-4ac5-9dde-c798cda8de2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c27220-21b8-4ac5-9dde-c798cda8de2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281d0bad-294d-460d-8415-676c4c775a71', 'volume_name': 'volume-281d0bad-294d-460d-8415-676c4c775a71', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866ab464-2e47-4257-9abc-5aefa2d5f7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866ab464-2e47-4257-9abc-5aefa2d5f7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b653dc-06be-4c6b-a93b-312a5a930332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:45 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Volume 281d0bad-294d-460d-8415-676c4c775a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281d0bad-294d-460d-8415-676c4c775a71', 'volume_size': 1} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1660681486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281d0bad-294d-460d-8415-676c4c775a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace5d4dbb14c4367839f80480b2370c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:13:46Z,use_quota=True,user_id='38a6a87e385f40749fd657d193a385f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Creating volume 281d0bad-294d-460d-8415-676c4c775a71 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:13:45 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:45 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71 1073741824 Sep 30 22:13:45 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:45 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:13:45 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Created reservations ['c8d126c0-e8bd-4b65-bc7a-8534e1ec9c09', '0fa703c7-5a01-4237-a0d3-469e5d5da5e3', '0122377b-bd6d-4aa9-9b85-0775e1dda417', 'b805a80f-bd28-4ab9-938f-dbe8a8f601a6'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:46 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:13:46 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:46 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.487s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:13:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Deleted volume successfully. Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4515b8c8-2593-4b66-9b55-e932ed67dd16 tempest-DeleteServersTestJSON-676454735 None] Lock "cinder-ea8fd900-3617-4d35-a264-8336f62cdd00-delete_volume" released by "delete_volume" :: held 4.653s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:13:46 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71 1073741824" returned: 0 in 0.903s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:46 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.575s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:13:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Deleted volume successfully. Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d48852eb-d3a1-4557-890e-515ad2c64a58 tempest-VolumesAdminNegativeTest-1482813188 None] Lock "cinder-5b3af10f-5937-4cc1-950e-f04d7fde6a87-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:13:46 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71 Sep 30 22:13:46 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:47 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71" returned: 0 in 0.267s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:13:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b653dc-06be-4c6b-a93b-312a5a930332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281d0bad-294d-460d-8415-676c4c775a71', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ae74a8-ba3e-4fdf-ad90-4284b4cbaeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Volume volume-281d0bad-294d-460d-8415-676c4c775a71 (281d0bad-294d-460d-8415-676c4c775a71): created successfully Sep 30 22:13:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ae74a8-ba3e-4fdf-ad90-4284b4cbaeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Flow 'volume_create_manager' (0d0d0f08-0cb8-4dc0-891f-d034604f439b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:13:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-be5238d4-6b9a-49e8-b768-2cb045d3bf01 tempest-ServersNegativeTestJSON-567862414 None] Created volume successfully. Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Flow 'volume_create_manager' (a606ee1a-f044-4364-9652-1b218f2c1561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f067e03-0635-41fe-97a7-e639a9485aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f067e03-0635-41fe-97a7-e639a9485aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-981283179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10964ce-23dc-4db0-a39b-4d842e00aa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace5d4dbb14c4367839f80480b2370c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:13:52Z,use_quota=True,user_id='38a6a87e385f40749fd657d193a385f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7f7da8-c29e-42c5-a760-6ad5301f7ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7f7da8-c29e-42c5-a760-6ad5301f7ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8191a378-6ff2-4cae-841b-85cf75d3cc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8191a378-6ff2-4cae-841b-85cf75d3cc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c10964ce-23dc-4db0-a39b-4d842e00aa1a', 'volume_name': 'volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f32fe9-a243-4f9c-b913-bd487aaf44bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f32fe9-a243-4f9c-b913-bd487aaf44bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200f3260-6d2b-49ea-8993-0ca3630f004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Volume c10964ce-23dc-4db0-a39b-4d842e00aa1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a', 'volume_size': 1} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-981283179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10964ce-23dc-4db0-a39b-4d842e00aa1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace5d4dbb14c4367839f80480b2370c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:13:52Z,use_quota=True,user_id='38a6a87e385f40749fd657d193a385f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Creating volume c10964ce-23dc-4db0-a39b-4d842e00aa1a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:13:51 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:13:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:51 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a 1073741824 Sep 30 22:13:51 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:52 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a 1073741824" returned: 0 in 0.576s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:52 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a Sep 30 22:13:52 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:52 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a" returned: 0 in 0.327s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:13:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200f3260-6d2b-49ea-8993-0ca3630f004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fd01f1-0b13-451b-b992-7b62a0e99f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:13:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Volume volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a (c10964ce-23dc-4db0-a39b-4d842e00aa1a): created successfully Sep 30 22:13:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fd01f1-0b13-451b-b992-7b62a0e99f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:13:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Flow 'volume_create_manager' (a606ee1a-f044-4364-9652-1b218f2c1561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:13:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3d4bd2b5-2151-49bb-abe1-3a0316c699aa tempest-ServersNegativeTestJSON-567862414 None] Created volume successfully. Sep 30 22:13:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "cinder-c10964ce-23dc-4db0-a39b-4d842e00aa1a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:13:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Lock "cinder-c10964ce-23dc-4db0-a39b-4d842e00aa1a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:13:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "cinder-quobyte-c10964ce-23dc-4db0-a39b-4d842e00aa1a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:13:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Lock "cinder-quobyte-c10964ce-23dc-4db0-a39b-4d842e00aa1a" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:13:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc4aed3-27b0-4566-b7dd-c4ea6642205e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:13:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:55 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a Sep 30 22:13:55 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:55 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a" returned: 0 in 0.373s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:55 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a Sep 30 22:13:55 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:56 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c10964ce-23dc-4db0-a39b-4d842e00aa1a" returned: 0 in 0.360s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Lock "cinder-quobyte-c10964ce-23dc-4db0-a39b-4d842e00aa1a" released by "delete_volume" :: held 0.787s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Created reservations ['8230adb1-c035-4719-9710-72bb9d3f1469', 'cdf3b175-2a1e-4ac6-9154-39c1bcd86bc7', '05cca215-0a25-4397-903e-d6611bbb14e2', '35cb9a40-c95f-467a-9651-74f13be75983'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:56 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:13:56 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "cinder-281d0bad-294d-460d-8415-676c4c775a71-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Lock "cinder-281d0bad-294d-460d-8415-676c4c775a71-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "cinder-quobyte-281d0bad-294d-460d-8415-676c4c775a71" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Lock "cinder-quobyte-281d0bad-294d-460d-8415-676c4c775a71" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f78604-819b-4f9e-af99-dba5766fa29a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:56 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.450s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:13:56 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71 Sep 30 22:13:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Deleted volume successfully. Sep 30 22:13:56 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ed81f59-56ea-4ded-8c4f-60a806598559 tempest-ServersNegativeTestJSON-567862414 None] Lock "cinder-c10964ce-23dc-4db0-a39b-4d842e00aa1a-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:13:57 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71" returned: 0 in 0.445s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:57 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71 Sep 30 22:13:57 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:57 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-281d0bad-294d-460d-8415-676c4c775a71" returned: 0 in 0.309s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Lock "cinder-quobyte-281d0bad-294d-460d-8415-676c4c775a71" released by "delete_volume" :: held 0.831s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Created reservations ['06dfb46a-f4d7-4ca7-8e10-b06cc544ca56', '75c56029-5dfd-4349-8bc3-fa66036b3c31', '047505f2-6d71-45f6-9b7f-102ff11c28a0', '5d05b21a-a043-4952-9ad3-35a86ec44f00'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:13:57 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:13:57 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:13:57 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.333s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:13:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Deleted volume successfully. Sep 30 22:13:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42ad6d4e-74df-41c2-9b0d-369b80fdb663 tempest-ServersNegativeTestJSON-567862414 None] Lock "cinder-281d0bad-294d-460d-8415-676c4c775a71-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:14:03 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:14:03 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:14:03 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.316s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:14:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:14:07 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=24,cinder:UPDATE=42,cinder:DELETE=4,cinder:INSERT=15 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:14:07 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=44,cinder:SELECT=37,cinder:INSERT=5,cinder:DELETE=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:14:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:14:37 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:14:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Flow 'volume_create_manager' (8d8ed8cf-2428-47c8-87b6-5d4739546da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:14:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74adfdb-6d6e-43fb-b908-56368f497199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:14:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74adfdb-6d6e-43fb-b908-56368f497199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1287387986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd768ad1-3785-433a-824b-87ec5470ebb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeafb97d869642138f8be7f2975584d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:14:38Z,use_quota=True,user_id='413afbc2e05646dfbdd5ce0854291a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:14:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893191e3-fae9-4816-9f5a-7a2f77796166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:14:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893191e3-fae9-4816-9f5a-7a2f77796166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0e7479-7bfe-4f22-8c91-f1049c1dc17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0e7479-7bfe-4f22-8c91-f1049c1dc17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd768ad1-3785-433a-824b-87ec5470ebb5', 'volume_name': 'volume-cd768ad1-3785-433a-824b-87ec5470ebb5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7c6bbd-9992-4e77-b92d-9b0ed86c3a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7c6bbd-9992-4e77-b92d-9b0ed86c3a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99a7b5c-4789-4dd3-bb5c-8494b1158995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:14:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Volume cd768ad1-3785-433a-824b-87ec5470ebb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd768ad1-3785-433a-824b-87ec5470ebb5', 'volume_size': 1} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1287387986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd768ad1-3785-433a-824b-87ec5470ebb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeafb97d869642138f8be7f2975584d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:14:38Z,use_quota=True,user_id='413afbc2e05646dfbdd5ce0854291a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Creating volume cd768ad1-3785-433a-824b-87ec5470ebb5 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:14:38 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:14:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:14:38 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5 1073741824 Sep 30 22:14:38 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:14:39 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Sep 30 22:14:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5 1073741824" returned: 0 in 0.967s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:14:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:14:39 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5 Sep 30 22:14:39 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:14:39 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Sep 30 22:14:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5" returned: 0 in 0.503s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:14:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:14:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:14:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99a7b5c-4789-4dd3-bb5c-8494b1158995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd768ad1-3785-433a-824b-87ec5470ebb5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:14:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b073b2a3-ed7f-41bd-973d-bd852e51076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:14:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Volume volume-cd768ad1-3785-433a-824b-87ec5470ebb5 (cd768ad1-3785-433a-824b-87ec5470ebb5): created successfully Sep 30 22:14:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b073b2a3-ed7f-41bd-973d-bd852e51076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:14:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Flow 'volume_create_manager' (8d8ed8cf-2428-47c8-87b6-5d4739546da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:14:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ae59fe5b-632a-4431-97cf-b3b7ab491f1d tempest-TaggedAttachmentsTest-1596323774 None] Created volume successfully. Sep 30 22:14:49 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:14:49 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:03 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:15:03 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:03 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.491s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:15:03 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Flow 'volume_create_manager' (3f1ffd76-0b10-4391-9c31-d5b666c1248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b06f60-6d42-4331-bccf-df2ffc3de930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31b06f60-6d42-4331-bccf-df2ffc3de930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-102543386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce3da1a-5ecb-4d26-984c-00dc09b038dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3408999eb54696bf8880131bd62239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:15:04Z,use_quota=True,user_id='fef4b661c5124885ae0195a790566016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbdb3de-8248-460e-8fff-3e30867aba79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbdb3de-8248-460e-8fff-3e30867aba79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc10972a-439a-45f9-82d8-2d13e28bf941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc10972a-439a-45f9-82d8-2d13e28bf941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce3da1a-5ecb-4d26-984c-00dc09b038dc', 'volume_name': 'volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998ebaf1-9211-4895-ab55-e5cf0887a9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998ebaf1-9211-4895-ab55-e5cf0887a9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e179b298-4698-4a0e-87d7-1a02015eafaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Volume 3ce3da1a-5ecb-4d26-984c-00dc09b038dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc', 'volume_size': 1} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-102543386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce3da1a-5ecb-4d26-984c-00dc09b038dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3408999eb54696bf8880131bd62239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:15:04Z,use_quota=True,user_id='fef4b661c5124885ae0195a790566016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Creating volume 3ce3da1a-5ecb-4d26-984c-00dc09b038dc {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:15:04 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:15:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:04 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc 1073741824 Sep 30 22:15:04 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:05 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc 1073741824" returned: 0 in 1.467s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:05 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc Sep 30 22:15:05 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:06 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc" returned: 0 in 0.905s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:15:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.521s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:15:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e179b298-4698-4a0e-87d7-1a02015eafaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0ebb80-2630-4813-a002-ff325b209397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Volume volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc (3ce3da1a-5ecb-4d26-984c-00dc09b038dc): created successfully Sep 30 22:15:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0ebb80-2630-4813-a002-ff325b209397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Flow 'volume_create_manager' (3f1ffd76-0b10-4391-9c31-d5b666c1248d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:15:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2e210c9d-edc3-40b3-bd49-776e595a883e tempest-ServerRescueNegativeTestJSON-792252852 None] Created volume successfully. Sep 30 22:15:16 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:15:16 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:15:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Acquiring lock "cinder-3ce3da1a-5ecb-4d26-984c-00dc09b038dc-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:15:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "cinder-3ce3da1a-5ecb-4d26-984c-00dc09b038dc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:15:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Acquiring lock "cinder-quobyte-3ce3da1a-5ecb-4d26-984c-00dc09b038dc" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:15:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "cinder-quobyte-3ce3da1a-5ecb-4d26-984c-00dc09b038dc" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:15:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[00834fe4-94c6-408c-aec8-2d3f4b16d708]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:15:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:25 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc Sep 30 22:15:25 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:25 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc" returned: 0 in 0.500s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:25 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc Sep 30 22:15:25 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:26 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ce3da1a-5ecb-4d26-984c-00dc09b038dc" returned: 0 in 0.389s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "cinder-quobyte-3ce3da1a-5ecb-4d26-984c-00dc09b038dc" released by "delete_volume" :: held 0.955s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Created reservations ['185f88fb-25fc-44f5-8394-daf687ddfeb1', 'a1fc67c3-3958-49c6-9ed5-4cad049b0f22', '3f1c3d0d-2142-46b6-a2ef-323ae318f730', '139e2864-783e-4493-9bce-c7ac2656092b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:26 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:15:26 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:26 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.382s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:15:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Deleted volume successfully. Sep 30 22:15:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c63221b9-f9c4-4584-a8f8-74aad91b5d5e tempest-ServerRescueNegativeTestJSON-792252852 None] Lock "cinder-3ce3da1a-5ecb-4d26-984c-00dc09b038dc-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Flow 'volume_create_manager' (dbf0c872-f5b0-48fc-bfdf-e4205515d7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5beab8-22d1-42d5-9b60-815788eb3c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5beab8-22d1-42d5-9b60-815788eb3c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1644102092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22c09590ae84e6eb8842432bd403322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:15:31Z,use_quota=True,user_id='75b78717d7fb4f1e824ea7ce631cef61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43354f1e-0a80-432e-b80d-109712cdb0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43354f1e-0a80-432e-b80d-109712cdb0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccbf9c2-7b77-4607-aa24-aa600dec123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccbf9c2-7b77-4607-aa24-aa600dec123b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b', 'volume_name': 'volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84a9dfa-70cb-4bbf-9ca9-7301be7562c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84a9dfa-70cb-4bbf-9ca9-7301be7562c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afd2d22-cb61-4af7-ae47-d6232132ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Volume 6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b', 'volume_size': 1} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1644102092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22c09590ae84e6eb8842432bd403322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:15:31Z,use_quota=True,user_id='75b78717d7fb4f1e824ea7ce631cef61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Creating volume 6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:15:31 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:15:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:31 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b 1073741824 Sep 30 22:15:31 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:32 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b 1073741824" returned: 0 in 0.708s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:32 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b Sep 30 22:15:32 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:32 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b" returned: 0 in 0.395s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:15:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:15:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0afd2d22-cb61-4af7-ae47-d6232132ca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5912af85-b519-4550-a945-4e8fb5695a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Volume volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b (6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b): created successfully Sep 30 22:15:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5912af85-b519-4550-a945-4e8fb5695a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Flow 'volume_create_manager' (dbf0c872-f5b0-48fc-bfdf-e4205515d7f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:15:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-63863c68-cf94-492b-b415-ecc71063db34 tempest-AttachVolumeNegativeTest-966324314 None] Created volume successfully. Sep 30 22:15:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8486be3e-03ff-4017-9df7-93b10a954e25 req-740bcab9-c816-410b-813d-abe6a1a1b101 tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:15:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8486be3e-03ff-4017-9df7-93b10a954e25 req-740bcab9-c816-410b-813d-abe6a1a1b101 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:15:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8486be3e-03ff-4017-9df7-93b10a954e25 req-740bcab9-c816-410b-813d-abe6a1a1b101 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:15:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-8486be3e-03ff-4017-9df7-93b10a954e25 req-740bcab9-c816-410b-813d-abe6a1a1b101 tempest-AttachVolumeNegativeTest-966324314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91f08d99-2d64-4ec2-bf56-3eca1901dc01', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:15:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-8486be3e-03ff-4017-9df7-93b10a954e25 req-740bcab9-c816-410b-813d-abe6a1a1b101 tempest-AttachVolumeNegativeTest-966324314 None] attachment_update completed successfully. Sep 30 22:15:44 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:15:44 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=13,cinder:SELECT=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Flow 'volume_create_manager' (2ae35633-6d08-4a75-ba47-4428dc792198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b59bbd-92f7-400b-9443-992342cc9e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b59bbd-92f7-400b-9443-992342cc9e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1256499152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0577898-f773-4dc5-94e7-2c8ca754d8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a638e186b4bf1844bc2a03d1e92ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:15:52Z,use_quota=True,user_id='b2527eef3b364bf69432cc56252235e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d338a9f-6ea7-4efb-8a04-1aaf266b696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d338a9f-6ea7-4efb-8a04-1aaf266b696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d670d552-f031-49d2-9522-963af6429a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d670d552-f031-49d2-9522-963af6429a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0577898-f773-4dc5-94e7-2c8ca754d8e0', 'volume_name': 'volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cf25da-2fe0-4990-a3a2-2e3cf7e73b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cf25da-2fe0-4990-a3a2-2e3cf7e73b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d53e135-89f7-48fa-baaf-352bf168600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Volume c0577898-f773-4dc5-94e7-2c8ca754d8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0', 'volume_size': 1} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1256499152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0577898-f773-4dc5-94e7-2c8ca754d8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a638e186b4bf1844bc2a03d1e92ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:15:52Z,use_quota=True,user_id='b2527eef3b364bf69432cc56252235e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Creating volume c0577898-f773-4dc5-94e7-2c8ca754d8e0 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:15:52 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:15:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:52 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 1073741824 Sep 30 22:15:52 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:53 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 1073741824" returned: 0 in 0.881s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:15:53 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 Sep 30 22:15:53 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:15:53 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Sep 30 22:15:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0" returned: 0 in 0.400s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:15:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:15:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:15:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d53e135-89f7-48fa-baaf-352bf168600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67eb55d-c722-409f-b052-ad0db3864d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:15:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Volume volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 (c0577898-f773-4dc5-94e7-2c8ca754d8e0): created successfully Sep 30 22:15:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67eb55d-c722-409f-b052-ad0db3864d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:15:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Flow 'volume_create_manager' (2ae35633-6d08-4a75-ba47-4428dc792198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:15:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-983f5f98-9cb2-44fc-b680-e28ecd58b101 tempest-ServerActionsTestOtherA-17232984 None] Created volume successfully. Sep 30 22:16:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-85f08c56-c3b9-48a2-87f8-6165c2465da2 req-6d8a3d9d-d8c0-4ff0-a7cc-f80309b968b5 tempest-TaggedAttachmentsTest-1596323774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-85f08c56-c3b9-48a2-87f8-6165c2465da2 req-6d8a3d9d-d8c0-4ff0-a7cc-f80309b968b5 tempest-TaggedAttachmentsTest-1596323774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-85f08c56-c3b9-48a2-87f8-6165c2465da2 req-6d8a3d9d-d8c0-4ff0-a7cc-f80309b968b5 tempest-TaggedAttachmentsTest-1596323774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-85f08c56-c3b9-48a2-87f8-6165c2465da2 req-6d8a3d9d-d8c0-4ff0-a7cc-f80309b968b5 tempest-TaggedAttachmentsTest-1596323774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-cd768ad1-3785-433a-824b-87ec5470ebb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25550784-40a2-4c8e-bf41-ba7c318f6df3', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:16:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-85f08c56-c3b9-48a2-87f8-6165c2465da2 req-6d8a3d9d-d8c0-4ff0-a7cc-f80309b968b5 tempest-TaggedAttachmentsTest-1596323774 None] attachment_update completed successfully. Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:03 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:16:03 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:03 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.330s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:16:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:16:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-b3971fc2-c91e-4fc2-9744-797e3d152f7c req-b3fa0c3a-9478-466e-a4f8-49f111bf1b28 tempest-TaggedAttachmentsTest-1596323774 None] Terminate volume connection completed successfully. Sep 30 22:16:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-b3971fc2-c91e-4fc2-9744-797e3d152f7c req-b3fa0c3a-9478-466e-a4f8-49f111bf1b28 tempest-TaggedAttachmentsTest-1596323774 None] Deleting attachment 25550784-40a2-4c8e-bf41-ba7c318f6df3. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:16:14 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=4,cinder:SELECT=11,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:16:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-d41cfb95-1440-464a-94b9-7d156dab7696 req-982a380e-ee30-413c-89fd-ef457c8e9925 tempest-AttachVolumeNegativeTest-966324314 None] Terminate volume connection completed successfully. Sep 30 22:16:21 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-d41cfb95-1440-464a-94b9-7d156dab7696 req-982a380e-ee30-413c-89fd-ef457c8e9925 tempest-AttachVolumeNegativeTest-966324314 None] Deleting attachment 91f08d99-2d64-4ec2-bf56-3eca1901dc01. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:16:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Acquiring lock "cinder-cd768ad1-3785-433a-824b-87ec5470ebb5-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:16:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Lock "cinder-cd768ad1-3785-433a-824b-87ec5470ebb5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:16:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Acquiring lock "cinder-quobyte-cd768ad1-3785-433a-824b-87ec5470ebb5" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:16:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Lock "cinder-quobyte-cd768ad1-3785-433a-824b-87ec5470ebb5" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:16:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[88731188-282f-41ca-9aaf-84417ac2aa45]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:16:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:26 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5 Sep 30 22:16:26 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:26 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5" returned: 0 in 0.380s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:26 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5 Sep 30 22:16:26 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:26 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cd768ad1-3785-433a-824b-87ec5470ebb5" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Lock "cinder-quobyte-cd768ad1-3785-433a-824b-87ec5470ebb5" released by "delete_volume" :: held 0.675s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Created reservations ['bfce90c4-4a7c-4cf8-959c-3367c04789d5', 'fba89a5a-4151-4e5f-85aa-b060934e726a', 'db172665-411f-4104-959e-f212fb7dc351', '060450d7-43a2-4bec-adc2-61ce1d2f33cc'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:26 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:16:26 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:26 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.274s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:26 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:16:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Deleted volume successfully. Sep 30 22:16:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c1ba7b2-d34e-4065-85a9-b10b46927e2f tempest-TaggedAttachmentsTest-1596323774 None] Lock "cinder-cd768ad1-3785-433a-824b-87ec5470ebb5-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:16:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-be6e06c3-6b3d-4f93-b50b-57260aa745b0 req-c6903030-aa77-4e5d-8008-5de60ff1147b tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-be6e06c3-6b3d-4f93-b50b-57260aa745b0 req-c6903030-aa77-4e5d-8008-5de60ff1147b tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-be6e06c3-6b3d-4f93-b50b-57260aa745b0 req-c6903030-aa77-4e5d-8008-5de60ff1147b tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-be6e06c3-6b3d-4f93-b50b-57260aa745b0 req-c6903030-aa77-4e5d-8008-5de60ff1147b tempest-ServerActionsTestOtherA-17232984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '766e79a8-e9f7-457d-8df0-b1ff0cc6b08c', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:16:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-be6e06c3-6b3d-4f93-b50b-57260aa745b0 req-c6903030-aa77-4e5d-8008-5de60ff1147b tempest-ServerActionsTestOtherA-17232984 None] attachment_update completed successfully. Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Flow 'volume_create_manager' (ca8c0a66-05bc-48ae-bdd2-b45a37d7888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c011b5-f22b-4867-bf8d-794fea5ba8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c011b5-f22b-4867-bf8d-794fea5ba8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1284583955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc06ccc-b028-4641-b556-1b056e5b0aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868397739bcf4e758577e97b9bf2f146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:16:36Z,use_quota=True,user_id='3799820b45cb4df59d5d19f627c0a93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f0c1e7-e0ed-4db1-8fda-a2fa61c5c61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f0c1e7-e0ed-4db1-8fda-a2fa61c5c61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b913a9-275b-434e-a263-ec8131ab5887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b913a9-275b-434e-a263-ec8131ab5887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc06ccc-b028-4641-b556-1b056e5b0aff', 'volume_name': 'volume-9dc06ccc-b028-4641-b556-1b056e5b0aff', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe5a7e0-67fc-439a-8f68-4a2c8c1fd045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe5a7e0-67fc-439a-8f68-4a2c8c1fd045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefd7b68-b02e-4e84-af65-400f1e76199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Volume 9dc06ccc-b028-4641-b556-1b056e5b0aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc06ccc-b028-4641-b556-1b056e5b0aff', 'volume_size': 1} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1284583955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc06ccc-b028-4641-b556-1b056e5b0aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868397739bcf4e758577e97b9bf2f146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:16:36Z,use_quota=True,user_id='3799820b45cb4df59d5d19f627c0a93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Creating volume 9dc06ccc-b028-4641-b556-1b056e5b0aff {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:16:36 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:16:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:36 devstack sudo[92023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff 1073741824 Sep 30 22:16:36 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:37 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff 1073741824" returned: 0 in 1.082s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:37 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff Sep 30 22:16:37 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:38 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff" returned: 0 in 0.277s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:16:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefd7b68-b02e-4e84-af65-400f1e76199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc06ccc-b028-4641-b556-1b056e5b0aff', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68894210-45e1-4229-a4c1-d0ab4e6faeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Volume volume-9dc06ccc-b028-4641-b556-1b056e5b0aff (9dc06ccc-b028-4641-b556-1b056e5b0aff): created successfully Sep 30 22:16:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68894210-45e1-4229-a4c1-d0ab4e6faeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Flow 'volume_create_manager' (ca8c0a66-05bc-48ae-bdd2-b45a37d7888f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:16:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bc6c6d71-d5d1-4d3d-b789-74a391c06684 tempest-AttachVolumeTestJSON-954727949 None] Created volume successfully. Sep 30 22:16:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-b286f72f-c5fc-4950-a81f-52c372c1c52b req-a3e1d089-8260-49e8-9b7c-981146e570e4 tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-b286f72f-c5fc-4950-a81f-52c372c1c52b req-a3e1d089-8260-49e8-9b7c-981146e570e4 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-b286f72f-c5fc-4950-a81f-52c372c1c52b req-a3e1d089-8260-49e8-9b7c-981146e570e4 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-b286f72f-c5fc-4950-a81f-52c372c1c52b req-a3e1d089-8260-49e8-9b7c-981146e570e4 tempest-AttachVolumeTestJSON-954727949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-9dc06ccc-b028-4641-b556-1b056e5b0aff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2421890-b4b9-40f6-a4aa-610ac9482def', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:16:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-b286f72f-c5fc-4950-a81f-52c372c1c52b req-a3e1d089-8260-49e8-9b7c-981146e570e4 tempest-AttachVolumeTestJSON-954727949 None] attachment_update completed successfully. Sep 30 22:16:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-682fb91f-62fd-4b7a-b1db-0df083af9675 req-3a6c914f-2ef0-41f0-97c3-72d649fd7629 tempest-ServerActionsTestOtherA-17232984 None] Terminate volume connection completed successfully. Sep 30 22:16:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-682fb91f-62fd-4b7a-b1db-0df083af9675 req-3a6c914f-2ef0-41f0-97c3-72d649fd7629 tempest-ServerActionsTestOtherA-17232984 None] Deleting attachment 766e79a8-e9f7-457d-8df0-b1ff0cc6b08c. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:16:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-682fb91f-62fd-4b7a-b1db-0df083af9675 req-08d0f60a-ccff-4334-b0e0-7d99caf7c8bf tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-682fb91f-62fd-4b7a-b1db-0df083af9675 req-08d0f60a-ccff-4334-b0e0-7d99caf7c8bf tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-682fb91f-62fd-4b7a-b1db-0df083af9675 req-08d0f60a-ccff-4334-b0e0-7d99caf7c8bf tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:44 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=30,cinder:UPDATE=23,cinder:INSERT=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:16:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-682fb91f-62fd-4b7a-b1db-0df083af9675 req-08d0f60a-ccff-4334-b0e0-7d99caf7c8bf tempest-ServerActionsTestOtherA-17232984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03b4bf69-def6-4812-9228-027068149a5d', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:16:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-682fb91f-62fd-4b7a-b1db-0df083af9675 req-08d0f60a-ccff-4334-b0e0-7d99caf7c8bf tempest-ServerActionsTestOtherA-17232984 None] attachment_update completed successfully. Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Flow 'volume_create_manager' (1d13b757-87d7-4ca8-a57b-0669a04ff11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e2d563-aab9-4d71-8591-47f09d0cf984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e2d563-aab9-4d71-8591-47f09d0cf984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2030390718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332fd2d-cb21-4ce6-a600-35d6579e9855,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49f39f1140f547129495dc219067cbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:16:45Z,use_quota=True,user_id='f78d915b4f804b9689d4d630cebc3da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e78fbd4-c8d2-4d9b-b5ed-dde7c42b0ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e78fbd4-c8d2-4d9b-b5ed-dde7c42b0ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e078a3-9dfe-402d-8f2e-e382244ebb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e078a3-9dfe-402d-8f2e-e382244ebb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0332fd2d-cb21-4ce6-a600-35d6579e9855', 'volume_name': 'volume-0332fd2d-cb21-4ce6-a600-35d6579e9855', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1692d6b-ec84-4756-a3d5-a348c2ceb866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1692d6b-ec84-4756-a3d5-a348c2ceb866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42175967-6e2b-4216-817a-16f35e55e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:45 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Volume 0332fd2d-cb21-4ce6-a600-35d6579e9855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0332fd2d-cb21-4ce6-a600-35d6579e9855', 'volume_size': 1} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2030390718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0332fd2d-cb21-4ce6-a600-35d6579e9855,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49f39f1140f547129495dc219067cbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:16:45Z,use_quota=True,user_id='f78d915b4f804b9689d4d630cebc3da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Creating volume 0332fd2d-cb21-4ce6-a600-35d6579e9855 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:16:45 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:16:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:45 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 1073741824 Sep 30 22:16:45 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:46 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 1073741824" returned: 0 in 0.818s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:46 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 Sep 30 22:16:46 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:47 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855" returned: 0 in 0.644s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:16:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42175967-6e2b-4216-817a-16f35e55e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0332fd2d-cb21-4ce6-a600-35d6579e9855', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ce77cb-f919-4695-bc04-2d753ca2b7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Volume volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 (0332fd2d-cb21-4ce6-a600-35d6579e9855): created successfully Sep 30 22:16:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ce77cb-f919-4695-bc04-2d753ca2b7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Flow 'volume_create_manager' (1d13b757-87d7-4ca8-a57b-0669a04ff11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:16:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7f8690c8-f474-434b-bdc9-437dca71e23d tempest-VolumesTestJSON-1038530788 None] Created volume successfully. Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Flow 'volume_create_manager' (4b46afdd-ce1e-425f-8844-401460cde029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c967e14-4560-46e4-97a3-4bdc04fbe58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c967e14-4560-46e4-97a3-4bdc04fbe58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1606499351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda53827-1751-4dd0-be38-fa1fa156866b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49f39f1140f547129495dc219067cbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:16:49Z,use_quota=True,user_id='f78d915b4f804b9689d4d630cebc3da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f842edf9-c130-4eef-94a5-1983138c510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f842edf9-c130-4eef-94a5-1983138c510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c483c214-0aac-4541-b080-0f613b9eb11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c483c214-0aac-4541-b080-0f613b9eb11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda53827-1751-4dd0-be38-fa1fa156866b', 'volume_name': 'volume-dda53827-1751-4dd0-be38-fa1fa156866b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b0170c-c47e-4b05-a9f0-1b40722faad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b0170c-c47e-4b05-a9f0-1b40722faad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf226f5-a5d9-4d47-ba2d-287a64956e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Volume dda53827-1751-4dd0-be38-fa1fa156866b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda53827-1751-4dd0-be38-fa1fa156866b', 'volume_size': 1} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1606499351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda53827-1751-4dd0-be38-fa1fa156866b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49f39f1140f547129495dc219067cbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:16:49Z,use_quota=True,user_id='f78d915b4f804b9689d4d630cebc3da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Creating volume dda53827-1751-4dd0-be38-fa1fa156866b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:16:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:16:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:49 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b 1073741824 Sep 30 22:16:49 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b 1073741824" returned: 0 in 0.932s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:50 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:50 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b Sep 30 22:16:50 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:50 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b" returned: 0 in 0.409s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:16:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf226f5-a5d9-4d47-ba2d-287a64956e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda53827-1751-4dd0-be38-fa1fa156866b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d5a7b1-1913-4da7-9f1b-55c63cf68677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Volume volume-dda53827-1751-4dd0-be38-fa1fa156866b (dda53827-1751-4dd0-be38-fa1fa156866b): created successfully Sep 30 22:16:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d5a7b1-1913-4da7-9f1b-55c63cf68677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Flow 'volume_create_manager' (4b46afdd-ce1e-425f-8844-401460cde029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:16:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0576c909-107e-4d58-8a90-7a3f84ad22c4 tempest-VolumesTestJSON-1038530788 None] Created volume successfully. Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Flow 'volume_create_manager' (16a52355-14ac-4322-875a-0156f5e94dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c0f738-4dfb-41fd-85e8-2cbdffafdab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c0f738-4dfb-41fd-85e8-2cbdffafdab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-235803447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e035364b-e29b-4e79-8082-b3540b39f346,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49f39f1140f547129495dc219067cbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:16:53Z,use_quota=True,user_id='f78d915b4f804b9689d4d630cebc3da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a6b92b-b73f-43d7-a7dc-054ba1e9ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a6b92b-b73f-43d7-a7dc-054ba1e9ba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c533c4-82fd-49be-bc40-c5c23ddf840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c533c4-82fd-49be-bc40-c5c23ddf840a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e035364b-e29b-4e79-8082-b3540b39f346', 'volume_name': 'volume-e035364b-e29b-4e79-8082-b3540b39f346', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dedc06-6c57-43af-b8e9-2ddee5e89cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dedc06-6c57-43af-b8e9-2ddee5e89cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500dead7-0844-4bbd-a3cc-0e37b6a47d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Volume e035364b-e29b-4e79-8082-b3540b39f346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e035364b-e29b-4e79-8082-b3540b39f346', 'volume_size': 1} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-235803447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e035364b-e29b-4e79-8082-b3540b39f346,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49f39f1140f547129495dc219067cbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:16:53Z,use_quota=True,user_id='f78d915b4f804b9689d4d630cebc3da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Creating volume e035364b-e29b-4e79-8082-b3540b39f346 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:16:52 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:16:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:52 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346 1073741824 Sep 30 22:16:52 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:53 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346 1073741824" returned: 0 in 0.464s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:53 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346 Sep 30 22:16:53 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:53 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:16:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500dead7-0844-4bbd-a3cc-0e37b6a47d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e035364b-e29b-4e79-8082-b3540b39f346', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd20fb3-1491-4389-b821-0bb6911cb3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:16:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Volume volume-e035364b-e29b-4e79-8082-b3540b39f346 (e035364b-e29b-4e79-8082-b3540b39f346): created successfully Sep 30 22:16:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd20fb3-1491-4389-b821-0bb6911cb3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:16:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Flow 'volume_create_manager' (16a52355-14ac-4322-875a-0156f5e94dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:16:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aea5ab8e-617a-4825-82f9-4ef4befaf123 tempest-VolumesTestJSON-1038530788 None] Created volume successfully. Sep 30 22:16:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Acquiring lock "cinder-e035364b-e29b-4e79-8082-b3540b39f346-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:16:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Lock "cinder-e035364b-e29b-4e79-8082-b3540b39f346-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:16:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Acquiring lock "cinder-quobyte-e035364b-e29b-4e79-8082-b3540b39f346" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:16:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Lock "cinder-quobyte-e035364b-e29b-4e79-8082-b3540b39f346" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:16:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7017e7ca-4ee6-4c40-9288-5d3bc5c4ad68]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:16:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:54 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346 Sep 30 22:16:54 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:55 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346" returned: 0 in 0.355s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:55 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346 Sep 30 22:16:55 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:55 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e035364b-e29b-4e79-8082-b3540b39f346" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Lock "cinder-quobyte-e035364b-e29b-4e79-8082-b3540b39f346" released by "delete_volume" :: held 0.648s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Created reservations ['eba1b419-7da7-428f-a67e-54d6ec908dbe', 'dc6507a4-4b44-4afd-9cf9-e2a5d81d9409', '31931851-c910-4c55-bb69-cef8413cee54', '449d8df0-e606-4269-9b07-1aa618fb4725'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:55 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:16:55 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:55 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.232s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:16:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Deleted volume successfully. Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec262fbb-53a8-4f81-808f-b7f2502fe10b tempest-VolumesTestJSON-1038530788 None] Lock "cinder-e035364b-e29b-4e79-8082-b3540b39f346-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "cinder-dda53827-1751-4dd0-be38-fa1fa156866b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Lock "cinder-dda53827-1751-4dd0-be38-fa1fa156866b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "cinder-quobyte-dda53827-1751-4dd0-be38-fa1fa156866b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Lock "cinder-quobyte-dda53827-1751-4dd0-be38-fa1fa156866b" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b679c8a-7cff-4344-ab55-689f14420812]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:16:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:55 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b Sep 30 22:16:55 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:56 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b" returned: 0 in 0.357s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:56 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b Sep 30 22:16:56 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:56 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda53827-1751-4dd0-be38-fa1fa156866b" returned: 0 in 0.235s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Lock "cinder-quobyte-dda53827-1751-4dd0-be38-fa1fa156866b" released by "delete_volume" :: held 0.635s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Created reservations ['bd8740e9-6c3d-48b4-9262-b89c405f47dc', '7cf344a4-4002-475a-bc04-d9135f5a28d2', '4500cf05-1b42-49aa-8389-b7ea8a738cf1', '281cd90a-2c9f-4ca8-85fb-00992b6fe1fe'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:56 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:16:56 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:56 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:16:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Deleted volume successfully. Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a477e19b-4e3f-498e-806a-ad9a33bffdc8 tempest-VolumesTestJSON-1038530788 None] Lock "cinder-dda53827-1751-4dd0-be38-fa1fa156866b-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "cinder-0332fd2d-cb21-4ce6-a600-35d6579e9855-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Lock "cinder-0332fd2d-cb21-4ce6-a600-35d6579e9855-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "cinder-quobyte-0332fd2d-cb21-4ce6-a600-35d6579e9855" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Lock "cinder-quobyte-0332fd2d-cb21-4ce6-a600-35d6579e9855" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[895474ee-f62a-4615-816d-10fdef7c4604]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:16:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:57 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 Sep 30 22:16:57 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:57 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855" returned: 0 in 0.373s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:57 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855 Sep 30 22:16:57 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:57 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0332fd2d-cb21-4ce6-a600-35d6579e9855" returned: 0 in 0.261s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Lock "cinder-quobyte-0332fd2d-cb21-4ce6-a600-35d6579e9855" released by "delete_volume" :: held 0.679s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Created reservations ['a7dd7bdd-4c6a-4328-be88-fe525ef1b379', 'b0a74efc-0854-403a-91a9-494271cdc2df', 'f92c8046-0921-4228-9337-72ec0c804e04', 'eb98d860-e253-4937-8a20-62ef373da1a9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:16:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:16:57 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:16:57 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:16:58 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Sep 30 22:16:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.258s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:16:58 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:16:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Deleted volume successfully. Sep 30 22:16:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-75387d45-1665-45ec-9096-1c13669f3a03 tempest-VolumesTestJSON-1038530788 None] Lock "cinder-0332fd2d-cb21-4ce6-a600-35d6579e9855-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Flow 'volume_create_manager' (3674e50b-38c0-4d5e-875d-29328733489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d648e2d4-d08d-4dbd-b238-03600ceb6390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d648e2d4-d08d-4dbd-b238-03600ceb6390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-185851469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d871f72b-66f8-42be-a692-ebb8eff93cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22c09590ae84e6eb8842432bd403322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:03Z,use_quota=True,user_id='75b78717d7fb4f1e824ea7ce631cef61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8480406-9917-44a1-9d94-229324a0852c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8480406-9917-44a1-9d94-229324a0852c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c3598c-3187-4de1-8a35-1f6f6564b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c3598c-3187-4de1-8a35-1f6f6564b271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd871f72b-66f8-42be-a692-ebb8eff93cfe', 'volume_name': 'volume-d871f72b-66f8-42be-a692-ebb8eff93cfe', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832dea44-7d72-42a6-9801-4a01988f7aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832dea44-7d72-42a6-9801-4a01988f7aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86528fc7-689f-43a8-9e9c-ef4479c90db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:02 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Volume d871f72b-66f8-42be-a692-ebb8eff93cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d871f72b-66f8-42be-a692-ebb8eff93cfe', 'volume_size': 1} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-185851469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d871f72b-66f8-42be-a692-ebb8eff93cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22c09590ae84e6eb8842432bd403322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:03Z,use_quota=True,user_id='75b78717d7fb4f1e824ea7ce631cef61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Creating volume d871f72b-66f8-42be-a692-ebb8eff93cfe {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:17:02 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:17:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:02 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe 1073741824 Sep 30 22:17:02 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:03 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe 1073741824" returned: 0 in 0.486s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:03 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:17:03 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:03 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe Sep 30 22:17:03 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:03 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.279s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:17:03 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe" returned: 0 in 0.275s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86528fc7-689f-43a8-9e9c-ef4479c90db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d871f72b-66f8-42be-a692-ebb8eff93cfe', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095e77f8-e1fc-43fe-9eaa-94e2bba4bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Volume volume-d871f72b-66f8-42be-a692-ebb8eff93cfe (d871f72b-66f8-42be-a692-ebb8eff93cfe): created successfully Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095e77f8-e1fc-43fe-9eaa-94e2bba4bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Flow 'volume_create_manager' (3674e50b-38c0-4d5e-875d-29328733489b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1093774a-99bf-4a99-b33a-ef911b9943ff tempest-AttachVolumeNegativeTest-966324314 None] Created volume successfully. Sep 30 22:17:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-4e775ee6-223b-43a5-805a-ccdc9bee91e1 req-43adb512-9e0c-4d97-a994-ae79a09348fd tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-4e775ee6-223b-43a5-805a-ccdc9bee91e1 req-43adb512-9e0c-4d97-a994-ae79a09348fd tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-4e775ee6-223b-43a5-805a-ccdc9bee91e1 req-43adb512-9e0c-4d97-a994-ae79a09348fd tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-4e775ee6-223b-43a5-805a-ccdc9bee91e1 req-43adb512-9e0c-4d97-a994-ae79a09348fd tempest-AttachVolumeNegativeTest-966324314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-d871f72b-66f8-42be-a692-ebb8eff93cfe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01177e19-f890-49ef-879e-61b2cfd8645d', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:17:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-4e775ee6-223b-43a5-805a-ccdc9bee91e1 req-43adb512-9e0c-4d97-a994-ae79a09348fd tempest-AttachVolumeNegativeTest-966324314 None] attachment_update completed successfully. Sep 30 22:17:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-41bbd01a-0522-4a85-b882-fa11a2e1df32 tempest-GroupSnapshotsV319Test-775777345 None] Group tempest-GroupSnapshotsV319Test-Group-1651925732: creating Sep 30 22:17:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-41bbd01a-0522-4a85-b882-fa11a2e1df32 tempest-GroupSnapshotsV319Test-775777345 None] Group tempest-GroupSnapshotsV319Test-Group-1651925732: created successfully Sep 30 22:17:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-41bbd01a-0522-4a85-b882-fa11a2e1df32 tempest-GroupSnapshotsV319Test-775777345 None] Create group completed successfully. Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Flow 'volume_create_manager' (5d6a5f1d-c137-4569-86db-aea6009b074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c61483-cfcd-47f2-9191-11b7e384915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c61483-cfcd-47f2-9191-11b7e384915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1744495559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2a5dc3f-0397-495d-beca-586e3d6206b4,host='devstack@QuobyteHD#QuobyteHD',id=94c56b12-9959-4d35-b20e-060d37f980c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b16075064a44a98adef3e0762bfc1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:08Z,use_quota=True,user_id='e16f24b1013f451bb2f6cb0fb983753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a3b6dcc-3c5c-40eb-b171-15511e8187a3),volume_type_id=3a3b6dcc-3c5c-40eb-b171-15511e8187a3)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be751a32-8867-4742-9daf-1bc5d61c6723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be751a32-8867-4742-9daf-1bc5d61c6723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa175f1a-ab23-42d9-b145-aa77834c4c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa175f1a-ab23-42d9-b145-aa77834c4c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94c56b12-9959-4d35-b20e-060d37f980c9', 'volume_name': 'volume-94c56b12-9959-4d35-b20e-060d37f980c9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda56a3d-a989-4de3-b2e3-0899fcaf200f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda56a3d-a989-4de3-b2e3-0899fcaf200f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ef313f-d396-4868-829f-cc5ac445c1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Volume 94c56b12-9959-4d35-b20e-060d37f980c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94c56b12-9959-4d35-b20e-060d37f980c9', 'volume_size': 1} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2a5dc3f-0397-495d-beca-586e3d6206b4,created_at=2026-09-30T20:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1744495559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2a5dc3f-0397-495d-beca-586e3d6206b4,host='devstack@QuobyteHD#QuobyteHD',id=94c56b12-9959-4d35-b20e-060d37f980c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b16075064a44a98adef3e0762bfc1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:08Z,use_quota=True,user_id='e16f24b1013f451bb2f6cb0fb983753d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a3b6dcc-3c5c-40eb-b171-15511e8187a3),volume_type_id=3a3b6dcc-3c5c-40eb-b171-15511e8187a3)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Creating volume 94c56b12-9959-4d35-b20e-060d37f980c9 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:17:07 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:17:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:07 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 1073741824 Sep 30 22:17:07 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:08 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 1073741824" returned: 0 in 0.485s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:08 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 Sep 30 22:17:08 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-f9de765c-1ce9-44a1-a5aa-9fa8a41fd4a0 req-e5d6ec16-8034-4f09-b42f-347789fc0027 tempest-AttachVolumeNegativeTest-966324314 None] Terminate volume connection completed successfully. Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f9de765c-1ce9-44a1-a5aa-9fa8a41fd4a0 req-e5d6ec16-8034-4f09-b42f-347789fc0027 tempest-AttachVolumeNegativeTest-966324314 None] Deleting attachment 01177e19-f890-49ef-879e-61b2cfd8645d. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:17:08 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9" returned: 0 in 0.294s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ef313f-d396-4868-829f-cc5ac445c1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c56b12-9959-4d35-b20e-060d37f980c9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d260a42-8878-4517-b9e4-dd5a7b76baf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Volume volume-94c56b12-9959-4d35-b20e-060d37f980c9 (94c56b12-9959-4d35-b20e-060d37f980c9): created successfully Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d260a42-8878-4517-b9e4-dd5a7b76baf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Flow 'volume_create_manager' (5d6a5f1d-c137-4569-86db-aea6009b074f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b61ad1b2-13c3-4eba-acea-de91dddabf2a tempest-GroupSnapshotsV319Test-775777345 None] Created volume successfully. Sep 30 22:17:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] GroupSnapshot a230a350-29cd-41fe-a1a8-92c4835d4f1c: creating. Sep 30 22:17:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Group snapshot a230a350-29cd-41fe-a1a8-92c4835d4f1c: creating. {{(pid=87240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 22:17:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Creating offline snapshot b3263e33-61cb-407c-9904-1aa1ec008f42 of volume 94c56b12-9959-4d35-b20e-060d37f980c9 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:17:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b336f94-75f7-48fd-b024-efd240281a13]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:09 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 Sep 30 22:17:09 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:09 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9" returned: 0 in 0.468s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:09 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 1G Sep 30 22:17:09 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:10 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 1G" returned: 0 in 0.541s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c56b12-9959-4d35-b20e-060d37f980c9 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:10 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c56b12-9959-4d35-b20e-060d37f980c9 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 Sep 30 22:17:10 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:10 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94c56b12-9959-4d35-b20e-060d37f980c9 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42" returned: 0 in 0.324s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:10 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:17:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:10 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 Sep 30 22:17:10 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:10 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42" returned: 0 in 0.304s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:10 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.info Sep 30 22:17:10 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:11 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.info" returned: 0 in 0.387s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:11 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:17:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:11 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.info Sep 30 22:17:11 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:11 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.info" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-22f45bf4-2322-4399-a942-611c89335445 tempest-GroupSnapshotsV319Test-775777345 None] group_snapshot a230a350-29cd-41fe-a1a8-92c4835d4f1c: created successfully Sep 30 22:17:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] group_snapshot a230a350-29cd-41fe-a1a8-92c4835d4f1c: deleting Sep 30 22:17:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] group_snapshot a230a350-29cd-41fe-a1a8-92c4835d4f1c: deleting {{(pid=87240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 22:17:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Acquiring lock "cinder-quobyte-94c56b12-9959-4d35-b20e-060d37f980c9" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Lock "cinder-quobyte-94c56b12-9959-4d35-b20e-060d37f980c9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Acquiring lock "cinder-quobyte-b3263e33-61cb-407c-9904-1aa1ec008f42" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Lock "cinder-quobyte-b3263e33-61cb-407c-9904-1aa1ec008f42" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Deleting offline snapshot b3263e33-61cb-407c-9904-1aa1ec008f42 of volume 94c56b12-9959-4d35-b20e-060d37f980c9 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:17:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] snapshot_file for this snap is: volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:17:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1b3308-1270-4996-ba73-b971b2d900d6]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:13 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 Sep 30 22:17:13 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:13 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42" returned: 0 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94c56b12-9959-4d35-b20e-060d37f980c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:17:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1800c8dd-c0dd-41ab-9def-8ac08ee970fa]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:13 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 Sep 30 22:17:13 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:13 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:13 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 Sep 30 22:17:13 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:14 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42" returned: 0 in 0.379s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:14 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42 Sep 30 22:17:14 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:14 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9.b3263e33-61cb-407c-9904-1aa1ec008f42" returned: 0 in 0.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Lock "cinder-quobyte-b3263e33-61cb-407c-9904-1aa1ec008f42" released by "_delete_snapshot" :: held 1.517s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Lock "cinder-quobyte-94c56b12-9959-4d35-b20e-060d37f980c9" released by "delete_snapshot" :: held 1.543s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:14 devstack cinder-volume[87240]: WARNING cinder.quota [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1582371403 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1582371403, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:17:14 devstack cinder-volume[87240]: WARNING cinder.quota [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1582371403 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1582371403, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:17:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] Created reservations ['103689a1-11b5-4caf-b1c2-9b4650d8fb56', '37e28a15-97f5-4e61-bee6-7cea056160c1', '8f5ce42d-5c93-45ca-95ff-a4efabc0ea75', '185fe29f-0563-42bc-b5ca-d285c9f32960'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:17:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5e66bdc6-1ca3-4e7a-84b8-c7024b67467e tempest-GroupSnapshotsV319Test-775777345 None] group_snapshot a230a350-29cd-41fe-a1a8-92c4835d4f1c: deleted successfully Sep 30 22:17:15 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=83,cinder:INSERT=16,cinder:UPDATE=63,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:17:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Acquiring lock "cinder-quobyte-94c56b12-9959-4d35-b20e-060d37f980c9" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Lock "cinder-quobyte-94c56b12-9959-4d35-b20e-060d37f980c9" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[04423a3c-34e2-4446-a3a9-5a4b6fe5685f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:15 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 Sep 30 22:17:15 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:15 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9" returned: 0 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:15 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9 Sep 30 22:17:15 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:16 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-94c56b12-9959-4d35-b20e-060d37f980c9" returned: 0 in 0.251s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Lock "cinder-quobyte-94c56b12-9959-4d35-b20e-060d37f980c9" released by "delete_volume" :: held 0.725s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Created reservations ['3ccd259c-6dd2-4826-b58a-e70eab5df08b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:17:16 devstack cinder-volume[87240]: WARNING cinder.quota [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1582371403 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1582371403, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Created reservations ['dda6b37b-6a02-4344-b2ec-be5f99cb7d2d', '187e9ef7-80db-428c-908a-c33e2623ea9f', '0fc8e887-e2ad-4c9d-a922-c721caafce64', '2b537904-28de-4ffa-9e00-78afee6a36f2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:16 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:17:16 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:16 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.307s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:17:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3df151e6-1b67-4707-8b1d-4d58ce4ae580 tempest-GroupSnapshotsV319Test-775777345 None] Delete group completed successfully. Sep 30 22:17:26 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=7,cinder:SELECT=9,cinder:INSERT=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:17:26 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=54,cinder:UPDATE=65,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:17:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:17:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Flow 'volume_create_manager' (22f199c2-24f8-4f53-800e-43a79e009ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e82fbc-73fc-46dd-a2c0-b19988720177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e82fbc-73fc-46dd-a2c0-b19988720177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1446173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af316ca1-a434-4a06-8015-44ffd8774343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b240c30dc44d39f4aed4ebb92e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:30Z,use_quota=True,user_id='480f6634024c4560bf4f603553200ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddec71d3-16b9-42a0-ba0f-9e2f100a2a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddec71d3-16b9-42a0-ba0f-9e2f100a2a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ffa789-ef46-4a67-b716-78f6fb1fae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:29 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:17:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ffa789-ef46-4a67-b716-78f6fb1fae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af316ca1-a434-4a06-8015-44ffd8774343', 'volume_name': 'volume-af316ca1-a434-4a06-8015-44ffd8774343', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f93df97-0eb9-4138-9afd-49790138a7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f93df97-0eb9-4138-9afd-49790138a7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a785200-54d9-4048-943e-36f8bf4a8026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Volume af316ca1-a434-4a06-8015-44ffd8774343: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af316ca1-a434-4a06-8015-44ffd8774343', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 22:17:30 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Trying to clone af316ca1-a434-4a06-8015-44ffd8774343 from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:17:30 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:17:30 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Image download 20.69 MB at 20.69 MB/s Sep 30 22:17:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b917f0-15b5-4aed-ba16-88ceb8631e00]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:30 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD Sep 30 22:17:30 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:31 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a is fetched for user 480f6634024c4560bf4f603553200ce4. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce1bde1-2dbd-45fe-a68b-f9a3f99260dc]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:31 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD Sep 30 22:17:31 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:31 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1446173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af316ca1-a434-4a06-8015-44ffd8774343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34b240c30dc44d39f4aed4ebb92e614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:30Z,use_quota=True,user_id='480f6634024c4560bf4f603553200ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Creating volume af316ca1-a434-4a06-8015-44ffd8774343 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:17:31 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:17:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:31 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 1073741824 Sep 30 22:17:31 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:32 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 1073741824" returned: 0 in 0.437s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:32 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 Sep 30 22:17:32 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:32 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Attempting download of 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume af316ca1-a434-4a06-8015-44ffd8774343. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa0ffd3-b816-4275-ae6b-66e49655463a]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_4w7izogw {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:32 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_4w7izogw Sep 30 22:17:32 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:32 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_4w7izogw" returned: 0 in 0.355s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_4w7izogw {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:32 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_4w7izogw Sep 30 22:17:32 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:33 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_4w7izogw" returned: 1 in 0.338s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_4w7izogw' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:17:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee05fbc-2439-49be-95ab-5a8b76627a5f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:33 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD Sep 30 22:17:33 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:33 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:33 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a was qcow2, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:17:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:33 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 Sep 30 22:17:33 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:35 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343" returned: 0 in 2.034s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_cmqx2q4zdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:17:35 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Converted 112.00 MB image at 55.03 MB/s Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:35 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 1G Sep 30 22:17:35 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:35 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 1G" returned: 0 in 0.319s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Downloaded image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume af316ca1-a434-4a06-8015-44ffd8774343 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a for user 480f6634024c4560bf4f603553200ce4 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Marking volume af316ca1-a434-4a06-8015-44ffd8774343 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Copying metadata from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a to af316ca1-a434-4a06-8015-44ffd8774343. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Creating volume glance metadata for volume af316ca1-a434-4a06-8015-44ffd8774343 backed by image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a785200-54d9-4048-943e-36f8bf4a8026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af316ca1-a434-4a06-8015-44ffd8774343', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89da31d6-4f24-4b11-bf12-b5ce955d633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Volume volume-af316ca1-a434-4a06-8015-44ffd8774343 (af316ca1-a434-4a06-8015-44ffd8774343): created successfully Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89da31d6-4f24-4b11-bf12-b5ce955d633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Flow 'volume_create_manager' (22f199c2-24f8-4f53-800e-43a79e009ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-89d74f65-bd03-4151-9646-ec2ba1e4234d tempest-VolumesImageMetadata-1742327391 None] Created volume successfully. Sep 30 22:17:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Acquiring lock "cinder-af316ca1-a434-4a06-8015-44ffd8774343-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Lock "cinder-af316ca1-a434-4a06-8015-44ffd8774343-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Acquiring lock "cinder-quobyte-af316ca1-a434-4a06-8015-44ffd8774343" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Lock "cinder-quobyte-af316ca1-a434-4a06-8015-44ffd8774343" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4c246f-378a-40d5-8aff-38577e73705d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:36 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 Sep 30 22:17:36 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:37 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343" returned: 0 in 0.342s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:37 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343 Sep 30 22:17:37 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:37 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-af316ca1-a434-4a06-8015-44ffd8774343" returned: 0 in 0.233s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Lock "cinder-quobyte-af316ca1-a434-4a06-8015-44ffd8774343" released by "delete_volume" :: held 0.619s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Created reservations ['83b63e3a-9b26-4980-8c68-e46d005c343d', '3244490e-3d6c-4e68-9693-c299c4d7188d', '406c81f4-8fa4-4564-9e90-c8dd8f2a44c8', '978948f0-a25d-413f-a08c-693709d32f24'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:37 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:17:37 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:37 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:17:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Deleted volume successfully. Sep 30 22:17:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0227b36d-e5b4-4d65-9eaf-2510e0f2cfda tempest-VolumesImageMetadata-1742327391 None] Lock "cinder-af316ca1-a434-4a06-8015-44ffd8774343-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Flow 'volume_create_manager' (78234712-73f2-4778-ae50-2b58c9fdee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e422fe47-721d-4843-bf10-0d4d2e0810c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e422fe47-721d-4843-bf10-0d4d2e0810c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1175928984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7754b25b-3e11-4c94-be6a-ada6d7b63116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe4e429e4cb453cac30831eaa83b17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:41Z,use_quota=True,user_id='eca6f2271fe5456e9b37b8349a208a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57478477-e9ed-484b-8bc5-5022bbb068d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57478477-e9ed-484b-8bc5-5022bbb068d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c830763-5953-4c93-80eb-235e7ae83890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c830763-5953-4c93-80eb-235e7ae83890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7754b25b-3e11-4c94-be6a-ada6d7b63116', 'volume_name': 'volume-7754b25b-3e11-4c94-be6a-ada6d7b63116', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef44b68-bcb7-49a4-a00f-416b2abc501d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef44b68-bcb7-49a4-a00f-416b2abc501d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32744b7-2edd-491c-bd10-2964e4f9924d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Volume 7754b25b-3e11-4c94-be6a-ada6d7b63116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7754b25b-3e11-4c94-be6a-ada6d7b63116', 'volume_size': 1} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1175928984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7754b25b-3e11-4c94-be6a-ada6d7b63116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe4e429e4cb453cac30831eaa83b17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:41Z,use_quota=True,user_id='eca6f2271fe5456e9b37b8349a208a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Creating volume 7754b25b-3e11-4c94-be6a-ada6d7b63116 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:17:41 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:41 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 1073741824 Sep 30 22:17:41 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:41 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 1073741824" returned: 0 in 0.428s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:41 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 Sep 30 22:17:41 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:42 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32744b7-2edd-491c-bd10-2964e4f9924d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7754b25b-3e11-4c94-be6a-ada6d7b63116', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4263845-fdaf-4f17-bf03-79b731a7a496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Volume volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 (7754b25b-3e11-4c94-be6a-ada6d7b63116): created successfully Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4263845-fdaf-4f17-bf03-79b731a7a496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Flow 'volume_create_manager' (78234712-73f2-4778-ae50-2b58c9fdee4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-28a4bb14-80bd-4ddd-add2-f2575eba8353 tempest-SnapshotMetadataTestJSON-761735094 None] Created volume successfully. Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Creating offline snapshot 9cc0cb6e-c81a-4ebb-aed1-dda23751b534 of volume 7754b25b-3e11-4c94-be6a-ada6d7b63116 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea8c6f0-1e2b-46c8-8fda-398e02025b51]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:42 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 Sep 30 22:17:42 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:42 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116" returned: 0 in 0.389s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:42 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 1G Sep 30 22:17:42 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:43 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 1G" returned: 0 in 0.402s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:43 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 Sep 30 22:17:43 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:43 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534" returned: 0 in 0.282s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:43 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 is being set with open permissions: ugo+rw Sep 30 22:17:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:43 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 Sep 30 22:17:43 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:43 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:43 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.info Sep 30 22:17:43 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:44 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.info" returned: 0 in 0.251s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:44 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.info is being set with open permissions: ugo+rw Sep 30 22:17:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:44 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.info Sep 30 22:17:44 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:44 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.info" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5b8ba0c1-f4a9-4c82-a02b-b37be70886ff tempest-SnapshotMetadataTestJSON-761735094 None] Create snapshot completed successfully Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Acquiring lock "cinder-9cc0cb6e-c81a-4ebb-aed1-dda23751b534-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-9cc0cb6e-c81a-4ebb-aed1-dda23751b534-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Acquiring lock "cinder-quobyte-7754b25b-3e11-4c94-be6a-ada6d7b63116" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-quobyte-7754b25b-3e11-4c94-be6a-ada6d7b63116" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Acquiring lock "cinder-quobyte-9cc0cb6e-c81a-4ebb-aed1-dda23751b534" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-quobyte-9cc0cb6e-c81a-4ebb-aed1-dda23751b534" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Deleting offline snapshot 9cc0cb6e-c81a-4ebb-aed1-dda23751b534 of volume 7754b25b-3e11-4c94-be6a-ada6d7b63116 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] snapshot_file for this snap is: volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c9772b-fee9-452e-8662-df7f7acfdab4]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:45 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 Sep 30 22:17:45 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:45 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534" returned: 0 in 0.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7754b25b-3e11-4c94-be6a-ada6d7b63116(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa52f19-8e71-4274-8ea1-a9c4c9d1c0a3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:45 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 Sep 30 22:17:45 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:46 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116" returned: 0 in 0.382s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:46 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 Sep 30 22:17:46 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:46 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534" returned: 0 in 0.420s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:46 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534 Sep 30 22:17:46 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Flow 'volume_create_manager' (a11717b7-854d-4c17-a939-8e89e08815b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5bf3d3-343c-440d-8b15-c5356f9ee10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5bf3d3-343c-440d-8b15-c5356f9ee10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1993488309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739bf94e-62fe-4619-8d6a-9baef7adeb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22c09590ae84e6eb8842432bd403322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:47Z,use_quota=True,user_id='75b78717d7fb4f1e824ea7ce631cef61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc03e6ae-c73f-4f0d-ac6d-b45056881b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc03e6ae-c73f-4f0d-ac6d-b45056881b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28aa3481-b211-431b-a95a-edc529c1fa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28aa3481-b211-431b-a95a-edc529c1fa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739bf94e-62fe-4619-8d6a-9baef7adeb13', 'volume_name': 'volume-739bf94e-62fe-4619-8d6a-9baef7adeb13', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e3aaca-234e-4264-9c3f-5d6ce097c6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e3aaca-234e-4264-9c3f-5d6ce097c6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e140570-84e0-457e-8dc1-526133fea9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Volume 739bf94e-62fe-4619-8d6a-9baef7adeb13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739bf94e-62fe-4619-8d6a-9baef7adeb13', 'volume_size': 1} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1993488309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739bf94e-62fe-4619-8d6a-9baef7adeb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22c09590ae84e6eb8842432bd403322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:47Z,use_quota=True,user_id='75b78717d7fb4f1e824ea7ce631cef61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Creating volume 739bf94e-62fe-4619-8d6a-9baef7adeb13 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:17:46 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:46 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 1073741824 Sep 30 22:17:46 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:46 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116.9cc0cb6e-c81a-4ebb-aed1-dda23751b534" returned: 0 in 0.278s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-quobyte-9cc0cb6e-c81a-4ebb-aed1-dda23751b534" released by "_delete_snapshot" :: held 1.545s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-quobyte-7754b25b-3e11-4c94-be6a-ada6d7b63116" released by "delete_snapshot" :: held 1.565s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:46 devstack cinder-volume[87240]: WARNING cinder.quota [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Created reservations ['ee2b0983-86ee-49a4-90df-5ed8eeb547d8', '3d4c42b8-8621-47b1-89e5-15a22e2a4e0d', '834660cd-7889-42fd-b75f-b3a38e484db5', '31f37ac3-e6a0-4d17-a9c2-50c44d7a9336'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:17:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Delete snapshot completed successfully. Sep 30 22:17:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-167d1c92-45e7-45be-81e8-253e1a972104 tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-9cc0cb6e-c81a-4ebb-aed1-dda23751b534-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:47 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 1073741824" returned: 0 in 0.431s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:47 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 Sep 30 22:17:47 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:47 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Acquiring lock "cinder-7754b25b-3e11-4c94-be6a-ada6d7b63116-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e140570-84e0-457e-8dc1-526133fea9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739bf94e-62fe-4619-8d6a-9baef7adeb13', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19095a5-086d-4db8-b748-12831e8484d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Volume volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 (739bf94e-62fe-4619-8d6a-9baef7adeb13): created successfully Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19095a5-086d-4db8-b748-12831e8484d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Flow 'volume_create_manager' (a11717b7-854d-4c17-a939-8e89e08815b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-7754b25b-3e11-4c94-be6a-ada6d7b63116-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0e695686-e368-4589-a96f-8a81cf7fbbfc tempest-AttachVolumeNegativeTest-966324314 None] Created volume successfully. Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Acquiring lock "cinder-quobyte-7754b25b-3e11-4c94-be6a-ada6d7b63116" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-quobyte-7754b25b-3e11-4c94-be6a-ada6d7b63116" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc00587-a7fd-4277-8490-e8e3203f2f73]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:47 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 Sep 30 22:17:47 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:47 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116" returned: 0 in 0.427s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:48 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116 Sep 30 22:17:48 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d0416667-5244-43dd-926a-352075044818 req-85d941f4-6f7e-4173-b84e-fd3d76f5de64 tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d0416667-5244-43dd-926a-352075044818 req-85d941f4-6f7e-4173-b84e-fd3d76f5de64 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:48 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7754b25b-3e11-4c94-be6a-ada6d7b63116" returned: 0 in 0.275s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d0416667-5244-43dd-926a-352075044818 req-85d941f4-6f7e-4173-b84e-fd3d76f5de64 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-quobyte-7754b25b-3e11-4c94-be6a-ada6d7b63116" released by "delete_volume" :: held 0.787s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-d0416667-5244-43dd-926a-352075044818 req-85d941f4-6f7e-4173-b84e-fd3d76f5de64 tempest-AttachVolumeNegativeTest-966324314 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-739bf94e-62fe-4619-8d6a-9baef7adeb13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd85dbf8a-e60a-442b-b8e3-946cb24f9cce', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Created reservations ['ba6859ea-2b05-43fc-8cec-173bf138cd4a', '303dd39e-ba63-443e-8b66-b89852bedd1f', 'd970e77d-8207-4413-9d92-54a7fb3e05a7', '8ebbcb4e-8b17-4818-90a0-e9d59c11a3b8'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:17:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-d0416667-5244-43dd-926a-352075044818 req-85d941f4-6f7e-4173-b84e-fd3d76f5de64 tempest-AttachVolumeNegativeTest-966324314 None] attachment_update completed successfully. Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:48 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:17:48 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:48 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.305s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:17:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Deleted volume successfully. Sep 30 22:17:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4da16d0f-07bc-469b-9f0c-702bd2f2fada tempest-SnapshotMetadataTestJSON-761735094 None] Lock "cinder-7754b25b-3e11-4c94-be6a-ada6d7b63116-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-4bb1c7b9-1a89-4c22-8240-2813768e779f req-c88d5caf-ed2e-4e13-ad0f-9e822963d555 tempest-AttachVolumeNegativeTest-966324314 None] Terminate volume connection completed successfully. Sep 30 22:17:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-4bb1c7b9-1a89-4c22-8240-2813768e779f req-c88d5caf-ed2e-4e13-ad0f-9e822963d555 tempest-AttachVolumeNegativeTest-966324314 None] Deleting attachment d85dbf8a-e60a-442b-b8e3-946cb24f9cce. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Flow 'volume_create_manager' (3a0f9bf7-9117-4022-ac2f-793b1f8b049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05696903-cecb-4582-9d2d-989f0cbb3769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05696903-cecb-4582-9d2d-989f0cbb3769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1042653866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b91a8ed-6329-47df-a365-753ff2b27965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b1b46ed0e24d66818cc1664965cfcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:57Z,use_quota=True,user_id='b79593f881a14e91a3020de16ecc0fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808c84fd-01b0-4341-9e7d-d61ba3f29f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808c84fd-01b0-4341-9e7d-d61ba3f29f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4afa1ac-84e1-45c0-983b-ebef3d14df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4afa1ac-84e1-45c0-983b-ebef3d14df9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b91a8ed-6329-47df-a365-753ff2b27965', 'volume_name': 'volume-8b91a8ed-6329-47df-a365-753ff2b27965', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410f9876-6399-4d50-b7c0-b3cfc2d11b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410f9876-6399-4d50-b7c0-b3cfc2d11b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d614fa48-2a1e-4ece-8a9d-eac3b756c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Volume 8b91a8ed-6329-47df-a365-753ff2b27965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b91a8ed-6329-47df-a365-753ff2b27965', 'volume_size': 1} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1042653866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b91a8ed-6329-47df-a365-753ff2b27965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b1b46ed0e24d66818cc1664965cfcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:17:57Z,use_quota=True,user_id='b79593f881a14e91a3020de16ecc0fe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Creating volume 8b91a8ed-6329-47df-a365-753ff2b27965 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:17:56 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:56 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965 1073741824 Sep 30 22:17:56 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "cinder-739bf94e-62fe-4619-8d6a-9baef7adeb13-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-739bf94e-62fe-4619-8d6a-9baef7adeb13-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "cinder-quobyte-739bf94e-62fe-4619-8d6a-9baef7adeb13" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-quobyte-739bf94e-62fe-4619-8d6a-9baef7adeb13" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b120b334-8b6b-447e-a330-542b3c94386f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:57 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965 1073741824" returned: 0 in 0.516s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:57 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 Sep 30 22:17:57 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:57 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965 Sep 30 22:17:57 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:57 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:57 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13 Sep 30 22:17:57 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:57 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d614fa48-2a1e-4ece-8a9d-eac3b756c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b91a8ed-6329-47df-a365-753ff2b27965', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec40f67-2e69-48f4-9daa-3c8ed46f51f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:17:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Volume volume-8b91a8ed-6329-47df-a365-753ff2b27965 (8b91a8ed-6329-47df-a365-753ff2b27965): created successfully Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec40f67-2e69-48f4-9daa-3c8ed46f51f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Flow 'volume_create_manager' (3a0f9bf7-9117-4022-ac2f-793b1f8b049b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:17:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-27cdd91b-3074-481d-9fda-a190be8dabc6 tempest-AbsoluteLimitsTests-1020260940 None] Created volume successfully. Sep 30 22:17:57 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-739bf94e-62fe-4619-8d6a-9baef7adeb13" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-quobyte-739bf94e-62fe-4619-8d6a-9baef7adeb13" released by "delete_volume" :: held 0.679s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Created reservations ['b3538666-313b-4afb-9846-6b9ebca32231', '6f8ea658-f2f9-4a68-9cd1-8c83e3c2e22c', '7f2780f3-839a-4ef0-986b-1024803c5b61', 'd8f5fcfc-43eb-47c0-bbb7-fdbf04e7b71a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:57 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:17:57 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:58 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:17:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Deleted volume successfully. Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18990d59-ce76-47c3-855a-694252617c3e tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-739bf94e-62fe-4619-8d6a-9baef7adeb13-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "cinder-d871f72b-66f8-42be-a692-ebb8eff93cfe-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-d871f72b-66f8-42be-a692-ebb8eff93cfe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "cinder-quobyte-d871f72b-66f8-42be-a692-ebb8eff93cfe" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-quobyte-d871f72b-66f8-42be-a692-ebb8eff93cfe" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa54404-1a76-4ccd-b59a-388b3d347a0e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:58 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe Sep 30 22:17:58 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:58 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe" returned: 0 in 0.362s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:58 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe Sep 30 22:17:58 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Acquiring lock "cinder-8b91a8ed-6329-47df-a365-753ff2b27965-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Lock "cinder-8b91a8ed-6329-47df-a365-753ff2b27965-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Acquiring lock "cinder-quobyte-8b91a8ed-6329-47df-a365-753ff2b27965" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Lock "cinder-quobyte-8b91a8ed-6329-47df-a365-753ff2b27965" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:58 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d871f72b-66f8-42be-a692-ebb8eff93cfe" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[713be41f-b291-40cb-8870-62db08768fc6]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-quobyte-d871f72b-66f8-42be-a692-ebb8eff93cfe" released by "delete_volume" :: held 0.674s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:58 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Created reservations ['b32a24be-d802-48ef-97fb-d4d99e430884', '41f70867-cfce-4a3b-8c6e-4469eb6e86e4', 'c9403f76-155d-4edd-845f-705fc46504be', '219d7f84-f25a-4170-ae48-de80a79e6324'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:17:59 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965 Sep 30 22:17:59 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:59 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:17:59 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:59 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:59 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:59 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965 Sep 30 22:17:59 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.268s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:17:59 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Deleted volume successfully. Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e1cea566-9c38-4fb7-974b-9a26d75d1145 tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-d871f72b-66f8-42be-a692-ebb8eff93cfe-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:59 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b91a8ed-6329-47df-a365-753ff2b27965" returned: 0 in 0.281s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Lock "cinder-quobyte-8b91a8ed-6329-47df-a365-753ff2b27965" released by "delete_volume" :: held 0.687s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "cinder-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Created reservations ['ed6f2942-08fa-4469-897b-88d93c0119e6', '6b48c117-64b4-4428-81a2-7e0c65b3283f', '6664b323-65b6-4999-9a2a-7f06270286ae', '1f36fe37-3c6e-4f7c-9436-4da40bf5a7b0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "cinder-quobyte-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-quobyte-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a58ae-eb7a-4c48-9b02-90f5c8c8933f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:17:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:17:59 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:17:59 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:17:59 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b Sep 30 22:17:59 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:00 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:18:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Deleted volume successfully. Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-83958c99-9346-41ea-9b18-e97391bc414a tempest-AbsoluteLimitsTests-1020260940 None] Lock "cinder-8b91a8ed-6329-47df-a365-753ff2b27965-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:00 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b" returned: 0 in 0.398s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:00 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b Sep 30 22:18:00 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:00 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-quobyte-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b" released by "delete_volume" :: held 0.695s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Created reservations ['9015ba8d-4e82-450f-bf1e-eb13bf155e9c', '08884b21-1390-436e-9fa5-1b4b8af91744', 'f5634426-59f6-4fc6-91a4-43b1c53b3cfa', '5a11eb3e-1411-4905-ba6a-00bbc1e9636c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:00 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:18:00 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:00 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.295s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:18:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Deleted volume successfully. Sep 30 22:18:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2e4089-2ba8-404c-9db2-d9851bb4736c tempest-AttachVolumeNegativeTest-966324314 None] Lock "cinder-6dd704f8-4bcd-4ceb-8cf2-d9703157ba9b-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:03 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:18:03 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:03 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.276s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:18:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Flow 'volume_create_manager' (a98b8c23-2c6c-4600-b7b8-a760150124f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee23fe58-df38-443f-9075-e3ad03c73467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee23fe58-df38-443f-9075-e3ad03c73467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1674206708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7f60b5-6a09-4ea9-8b51-5ecad866059e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695663b3271449f7ba853c55975dca1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:05Z,use_quota=True,user_id='98bfc27f481a42ce8cb721a70f467230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4130dd3c-8c91-49a4-983b-693561b41628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4130dd3c-8c91-49a4-983b-693561b41628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bffe504-4ae3-4aec-a918-bca8d2f04bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bffe504-4ae3-4aec-a918-bca8d2f04bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7f60b5-6a09-4ea9-8b51-5ecad866059e', 'volume_name': 'volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e779331-f6f8-4677-8f93-967c8da7264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e779331-f6f8-4677-8f93-967c8da7264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a019b25e-c61f-48c1-8c98-d1b63b53f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Volume 6b7f60b5-6a09-4ea9-8b51-5ecad866059e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e', 'volume_size': 1} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1674206708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7f60b5-6a09-4ea9-8b51-5ecad866059e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695663b3271449f7ba853c55975dca1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:05Z,use_quota=True,user_id='98bfc27f481a42ce8cb721a70f467230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Creating volume 6b7f60b5-6a09-4ea9-8b51-5ecad866059e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:18:05 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:05 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e 1073741824 Sep 30 22:18:05 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:05 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e 1073741824" returned: 0 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:05 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e Sep 30 22:18:05 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:05 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e" returned: 0 in 0.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:18:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a019b25e-c61f-48c1-8c98-d1b63b53f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150db4f4-3ea8-4ced-9341-ba28285248fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Volume volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e (6b7f60b5-6a09-4ea9-8b51-5ecad866059e): created successfully Sep 30 22:18:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150db4f4-3ea8-4ced-9341-ba28285248fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Flow 'volume_create_manager' (a98b8c23-2c6c-4600-b7b8-a760150124f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6fd4e8b1-9067-4343-a43c-7ba51ebf58a5 tempest-VolumesNegativeTest-1482886886 None] Created volume successfully. Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Flow 'volume_create_manager' (e3066793-a0ac-40fb-9de1-0e8219bb2914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7012ec6-171d-4f0e-a62b-918a4b0fba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7012ec6-171d-4f0e-a62b-918a4b0fba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2024994064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fc78c9-70fe-4d66-a98a-91e176c1b60d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aa79203023246afb4cb6a2a75f095c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:10Z,use_quota=True,user_id='c97db11c4fc74123ad88cb5d195d62f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e479cca-4cb3-4f33-8352-6221c40cead7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e479cca-4cb3-4f33-8352-6221c40cead7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b0b9a5-0a18-4bf7-ab0d-e57002b626a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b0b9a5-0a18-4bf7-ab0d-e57002b626a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87fc78c9-70fe-4d66-a98a-91e176c1b60d', 'volume_name': 'volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab318e2a-de0d-4e1f-b9ea-12a45fa1b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab318e2a-de0d-4e1f-b9ea-12a45fa1b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bbe7f0-1f3b-4600-923d-cfe7395c1cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Volume 87fc78c9-70fe-4d66-a98a-91e176c1b60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d', 'volume_size': 1} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2024994064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fc78c9-70fe-4d66-a98a-91e176c1b60d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aa79203023246afb4cb6a2a75f095c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:10Z,use_quota=True,user_id='c97db11c4fc74123ad88cb5d195d62f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Creating volume 87fc78c9-70fe-4d66-a98a-91e176c1b60d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:18:09 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:18:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:09 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d 1073741824 Sep 30 22:18:09 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:10 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d 1073741824" returned: 0 in 0.468s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:10 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d Sep 30 22:18:10 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:10 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d" returned: 0 in 0.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bbe7f0-1f3b-4600-923d-cfe7395c1cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc015aab-eb6a-4b01-9584-e26485d62bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Volume volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d (87fc78c9-70fe-4d66-a98a-91e176c1b60d): created successfully Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc015aab-eb6a-4b01-9584-e26485d62bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Flow 'volume_create_manager' (e3066793-a0ac-40fb-9de1-0e8219bb2914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-f1a33774-8ce4-435f-a7a6-598ba9a1d865 req-fb1f7d98-0ab8-4679-8de4-9d038d7819c4 tempest-VolumesGetTestJSON-119236698 None] Created volume successfully. Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Acquiring lock "cinder-87fc78c9-70fe-4d66-a98a-91e176c1b60d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Lock "cinder-87fc78c9-70fe-4d66-a98a-91e176c1b60d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Acquiring lock "cinder-quobyte-87fc78c9-70fe-4d66-a98a-91e176c1b60d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Lock "cinder-quobyte-87fc78c9-70fe-4d66-a98a-91e176c1b60d" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87fdc25-c433-48ba-aa50-dc2f2d90c0af]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:11 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d Sep 30 22:18:11 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:11 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d" returned: 0 in 0.395s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:11 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d Sep 30 22:18:11 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:11 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-87fc78c9-70fe-4d66-a98a-91e176c1b60d" returned: 0 in 0.544s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Lock "cinder-quobyte-87fc78c9-70fe-4d66-a98a-91e176c1b60d" released by "delete_volume" :: held 1.014s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG cinder.quota [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Created reservations ['10d231bf-4d3f-4a49-906b-272ebd1277ae', '2cfdf165-0f4f-4572-be54-e2e4c11e2ab4', '15fe9bcb-8451-4098-8e69-670b14f3f16d', '53f347b9-c4f2-4df0-bf3a-e0436f444582'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:12 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:18:12 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:12 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.366s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG cinder.manager [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:18:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Deleted volume successfully. Sep 30 22:18:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-379e2ac8-589a-47cd-bc59-2ce30a6e8075 req-4f38b506-159e-4403-bee6-781f94a8f5d7 tempest-VolumesGetTestJSON-119236698 None] Lock "cinder-87fc78c9-70fe-4d66-a98a-91e176c1b60d-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=70,cinder:UPDATE=85,cinder:INSERT=27,cinder:DELETE=6 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:18:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=73,cinder:INSERT=25,cinder:UPDATE=84,cinder:DELETE=8 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:18:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Acquiring lock "cinder-6b7f60b5-6a09-4ea9-8b51-5ecad866059e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Lock "cinder-6b7f60b5-6a09-4ea9-8b51-5ecad866059e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Acquiring lock "cinder-quobyte-6b7f60b5-6a09-4ea9-8b51-5ecad866059e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Lock "cinder-quobyte-6b7f60b5-6a09-4ea9-8b51-5ecad866059e" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c943ab6-a252-4184-a700-2e2ae549be64]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:25 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e Sep 30 22:18:25 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:25 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e" returned: 0 in 0.378s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:25 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e Sep 30 22:18:25 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:26 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6b7f60b5-6a09-4ea9-8b51-5ecad866059e" returned: 0 in 0.294s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Lock "cinder-quobyte-6b7f60b5-6a09-4ea9-8b51-5ecad866059e" released by "delete_volume" :: held 0.722s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Created reservations ['b59f894c-275d-4313-bad4-0e984cd2a6a3', 'da609371-0ce5-4173-918b-b43e843d2e1b', 'd33e681f-e60c-4c0b-b80d-6e8592d01b98', 'b6302fe9-2e2b-4a54-924d-7c471e0abbb9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:26 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:18:26 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:26 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.273s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:18:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Deleted volume successfully. Sep 30 22:18:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d50f41a6-c9f0-4920-8efc-6517b4d6b8a8 tempest-VolumesNegativeTest-1482886886 None] Lock "cinder-6b7f60b5-6a09-4ea9-8b51-5ecad866059e-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Flow 'volume_create_manager' (bf820dbb-5a20-4a81-8ea0-c66d11f7232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c02cd04-6c28-455f-8a8c-fc0fd705fdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c02cd04-6c28-455f-8a8c-fc0fd705fdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1345928680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca498bd-7567-405a-9698-10a86532b921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2f6a1b255b48b6aa95fd89755c888e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:34Z,use_quota=True,user_id='56a9a8b996084843943eb6cbad19813f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835c48b9-9d54-403c-b87f-71b65ee080c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835c48b9-9d54-403c-b87f-71b65ee080c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654d7593-0d59-469b-9dd7-aa43f09b767f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654d7593-0d59-469b-9dd7-aa43f09b767f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca498bd-7567-405a-9698-10a86532b921', 'volume_name': 'volume-4ca498bd-7567-405a-9698-10a86532b921', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc31f9ad-9489-417d-b808-67de127b5843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc31f9ad-9489-417d-b808-67de127b5843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f1b049-99b0-457d-86f3-39d0be0c7fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Volume 4ca498bd-7567-405a-9698-10a86532b921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca498bd-7567-405a-9698-10a86532b921', 'volume_size': 1} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1345928680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca498bd-7567-405a-9698-10a86532b921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2f6a1b255b48b6aa95fd89755c888e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:34Z,use_quota=True,user_id='56a9a8b996084843943eb6cbad19813f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Creating volume 4ca498bd-7567-405a-9698-10a86532b921 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:18:33 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:18:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:33 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921 1073741824 Sep 30 22:18:33 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:34 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921 1073741824" returned: 0 in 0.518s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:34 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921 Sep 30 22:18:34 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:34 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921" returned: 0 in 0.297s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:18:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f1b049-99b0-457d-86f3-39d0be0c7fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca498bd-7567-405a-9698-10a86532b921', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff96703-a4c0-468a-9b38-eb90be5e6152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:34 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Volume volume-4ca498bd-7567-405a-9698-10a86532b921 (4ca498bd-7567-405a-9698-10a86532b921): created successfully Sep 30 22:18:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff96703-a4c0-468a-9b38-eb90be5e6152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Flow 'volume_create_manager' (bf820dbb-5a20-4a81-8ea0-c66d11f7232f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1939ecf9-1b49-41a8-9ead-aaa58b8b00f4 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Created volume successfully. Sep 30 22:18:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Acquiring lock "cinder-4ca498bd-7567-405a-9698-10a86532b921-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "cinder-4ca498bd-7567-405a-9698-10a86532b921-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Acquiring lock "cinder-quobyte-4ca498bd-7567-405a-9698-10a86532b921" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "cinder-quobyte-4ca498bd-7567-405a-9698-10a86532b921" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2208f54-dae8-4e9b-85ed-d21d87757d34]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:36 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921 Sep 30 22:18:36 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:36 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921" returned: 0 in 0.413s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:36 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921 Sep 30 22:18:36 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:36 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4ca498bd-7567-405a-9698-10a86532b921" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "cinder-quobyte-4ca498bd-7567-405a-9698-10a86532b921" released by "delete_volume" :: held 0.738s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Created reservations ['7e89910d-cf90-46d9-8473-730cb3c2bb17', '1d66239a-f38d-4f62-a643-4322ae1643a3', '2dfd05df-3ce4-4f7f-867e-6609cc18f354', '518858d8-01d0-4b2a-82b8-3df39fab39c1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:36 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:18:36 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:37 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.309s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:18:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Deleted volume successfully. Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a9f1420e-ff0b-49c7-bb6c-1cea3768de2b tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "cinder-4ca498bd-7567-405a-9698-10a86532b921-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Flow 'volume_create_manager' (c9e0878b-96c3-43c6-9ad5-22845b51149e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942ae159-1f26-4931-b440-0d921e213649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942ae159-1f26-4931-b440-0d921e213649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1051295457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f06fdb-6c91-4e06-82b7-b60fb085f53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2f6a1b255b48b6aa95fd89755c888e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:38Z,use_quota=True,user_id='56a9a8b996084843943eb6cbad19813f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4297037-507d-4800-a55e-1e45bb077216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4297037-507d-4800-a55e-1e45bb077216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ff2749-4aeb-4c17-a38a-f6361c304e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ff2749-4aeb-4c17-a38a-f6361c304e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f06fdb-6c91-4e06-82b7-b60fb085f53d', 'volume_name': 'volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a933ef1-4100-4784-bd58-7467f49c55d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a933ef1-4100-4784-bd58-7467f49c55d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19242bea-54b9-47c4-b2cb-bdf6defbf99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:37 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Volume 18f06fdb-6c91-4e06-82b7-b60fb085f53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d', 'volume_size': 1} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1051295457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f06fdb-6c91-4e06-82b7-b60fb085f53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2f6a1b255b48b6aa95fd89755c888e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:38Z,use_quota=True,user_id='56a9a8b996084843943eb6cbad19813f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Creating volume 18f06fdb-6c91-4e06-82b7-b60fb085f53d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:18:37 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:18:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:37 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d 1073741824 Sep 30 22:18:37 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:38 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d 1073741824" returned: 0 in 0.504s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:38 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d Sep 30 22:18:38 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:38 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d" returned: 0 in 0.238s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:18:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19242bea-54b9-47c4-b2cb-bdf6defbf99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa4ee0a-478b-489c-9c43-8478f7f6e26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Volume volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d (18f06fdb-6c91-4e06-82b7-b60fb085f53d): created successfully Sep 30 22:18:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa4ee0a-478b-489c-9c43-8478f7f6e26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Flow 'volume_create_manager' (c9e0878b-96c3-43c6-9ad5-22845b51149e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-48150166-be72-4520-97e7-477cd782d218 tempest-VolumeQuotasAdminTestJSON-1941358101 None] Created volume successfully. Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (23840db1-269c-44be-a04b-fd4216582c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85007e8-297c-40c9-8786-910746096464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85007e8-297c-40c9-8786-910746096464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-180035279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d9ae74-3e9d-4f15-b374-740a315872a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ee174a84c54f9b8350c50b972410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:39Z,use_quota=True,user_id='68d9154ec6f94344aafb83f9613abecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f235ebf-f9ea-4047-a492-00f43b99c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f235ebf-f9ea-4047-a492-00f43b99c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2187eec-227c-4e09-a117-31b568dce5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2187eec-227c-4e09-a117-31b568dce5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d9ae74-3e9d-4f15-b374-740a315872a8', 'volume_name': 'volume-93d9ae74-3e9d-4f15-b374-740a315872a8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d644754-1bab-4976-a8f6-d5910324735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d644754-1bab-4976-a8f6-d5910324735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0c2fe3-7aad-4537-a22a-0d4b2183b3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Volume 93d9ae74-3e9d-4f15-b374-740a315872a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d9ae74-3e9d-4f15-b374-740a315872a8', 'volume_size': 1} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-180035279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d9ae74-3e9d-4f15-b374-740a315872a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ee174a84c54f9b8350c50b972410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:39Z,use_quota=True,user_id='68d9154ec6f94344aafb83f9613abecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Creating volume 93d9ae74-3e9d-4f15-b374-740a315872a8 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:18:39 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:39 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 1073741824 Sep 30 22:18:39 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:39 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 1073741824" returned: 0 in 0.416s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:39 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 Sep 30 22:18:39 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:40 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0c2fe3-7aad-4537-a22a-0d4b2183b3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d9ae74-3e9d-4f15-b374-740a315872a8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7344f92c-3fda-4bc4-9178-55e6fa50ce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Volume volume-93d9ae74-3e9d-4f15-b374-740a315872a8 (93d9ae74-3e9d-4f15-b374-740a315872a8): created successfully Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7344f92c-3fda-4bc4-9178-55e6fa50ce5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (23840db1-269c-44be-a04b-fd4216582c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f18748fd-feae-4d6e-a89b-e9a47bc202d4 tempest-VolumesSnapshotTestJSON-1881800282 None] Created volume successfully. Sep 30 22:18:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e41d1247-9ef5-4880-9ecc-03124cb427c0 tempest-VolumeQuotasAdminTestJSON-584630044 None] Transfer volume completed successfully. Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Creating offline snapshot 72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 of volume 93d9ae74-3e9d-4f15-b374-740a315872a8 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79320a8-cf71-4a62-9c89-561768e6d3aa]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:40 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 Sep 30 22:18:40 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Acquiring lock "cinder-18f06fdb-6c91-4e06-82b7-b60fb085f53d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Lock "cinder-18f06fdb-6c91-4e06-82b7-b60fb085f53d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Acquiring lock "cinder-quobyte-18f06fdb-6c91-4e06-82b7-b60fb085f53d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Lock "cinder-quobyte-18f06fdb-6c91-4e06-82b7-b60fb085f53d" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[68829592-df6d-4933-a0a3-b855118a30ac]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:41 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d Sep 30 22:18:41 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:41 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8" returned: 0 in 0.413s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:41 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 1G Sep 30 22:18:41 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:41 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d" returned: 0 in 0.378s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:41 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d Sep 30 22:18:41 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:41 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 1G" returned: 0 in 0.395s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d9ae74-3e9d-4f15-b374-740a315872a8 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:41 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d9ae74-3e9d-4f15-b374-740a315872a8 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 Sep 30 22:18:41 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:41 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-18f06fdb-6c91-4e06-82b7-b60fb085f53d" returned: 0 in 0.260s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Lock "cinder-quobyte-18f06fdb-6c91-4e06-82b7-b60fb085f53d" released by "delete_volume" :: held 0.684s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Created reservations ['2ce43075-07f7-4bd4-bd74-7b302400ed33', 'f6d2d94f-f869-4b30-8e4b-5361a1455cb8', 'f825e698-0349-4aaf-aa98-5e702674d2e3', '6e74d95f-6493-4b1a-a066-eea6b2cc0ccc'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:41 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:18:41 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:41 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d9ae74-3e9d-4f15-b374-740a315872a8 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7" returned: 0 in 0.301s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:41 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 is being set with open permissions: ugo+rw Sep 30 22:18:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:41 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 Sep 30 22:18:41 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:42 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.253s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:42 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:18:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Deleted volume successfully. Sep 30 22:18:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-48efe47a-0fbb-47e3-9fa0-c3d3a40bcd85 tempest-VolumeQuotasAdminTestJSON-431149680 None] Lock "cinder-18f06fdb-6c91-4e06-82b7-b60fb085f53d-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:42 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7" returned: 0 in 0.281s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:42 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.info Sep 30 22:18:42 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:42 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.info" returned: 0 in 0.273s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:42 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.info is being set with open permissions: ugo+rw Sep 30 22:18:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:42 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.info Sep 30 22:18:42 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:42 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.info" returned: 0 in 0.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2549c71f-b33b-48aa-8925-84c699b256fd tempest-VolumesSnapshotTestJSON-1881800282 None] Create snapshot completed successfully Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-93d9ae74-3e9d-4f15-b374-740a315872a8" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-93d9ae74-3e9d-4f15-b374-740a315872a8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Deleting offline snapshot 72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 of volume 93d9ae74-3e9d-4f15-b374-740a315872a8 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] snapshot_file for this snap is: volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a3df0-1d57-4200-9a35-43ab569999c3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:44 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 Sep 30 22:18:44 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:44 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7" returned: 0 in 0.440s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93d9ae74-3e9d-4f15-b374-740a315872a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[371ba6c8-3da6-450a-8242-89d7e5fa2f91]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:44 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 Sep 30 22:18:44 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:45 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8" returned: 0 in 0.368s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:45 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 Sep 30 22:18:45 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:45 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7" returned: 0 in 0.345s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:45 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7 Sep 30 22:18:45 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:45 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8.72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7" returned: 0 in 0.270s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7" released by "_delete_snapshot" :: held 1.553s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-93d9ae74-3e9d-4f15-b374-740a315872a8" released by "delete_snapshot" :: held 1.576s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Created reservations ['0ffcd584-8105-4125-bb5f-c503395d443a', 'f38622d2-587c-44bb-a077-64c34d935f70', 'c4342916-bee6-4799-b4b8-5f34c47bd196', '5bee4c54-8167-42bc-a610-40ccb56232b5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:18:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Delete snapshot completed successfully. Sep 30 22:18:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-08792766-3916-435a-8aaa-28ee06d9df3e tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-72475e4e-fb7e-4192-a8cb-bf90ddc5cbe7-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (97fee3a6-8049-4386-8497-1eb7ba5bcf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a881c2c-257b-41d7-ae94-cf99c8b4ff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a881c2c-257b-41d7-ae94-cf99c8b4ff52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2005562130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de901cd-4f29-4864-a803-c0b2b212a382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ee174a84c54f9b8350c50b972410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:47Z,use_quota=True,user_id='68d9154ec6f94344aafb83f9613abecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f0e9ca-8127-4473-aed4-c4c4f6c8bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f0e9ca-8127-4473-aed4-c4c4f6c8bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c98370-fd6d-48e6-b306-d31a648e7b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c98370-fd6d-48e6-b306-d31a648e7b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de901cd-4f29-4864-a803-c0b2b212a382', 'volume_name': 'volume-5de901cd-4f29-4864-a803-c0b2b212a382', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34364cf6-a05b-46f5-98c0-15a71405e1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34364cf6-a05b-46f5-98c0-15a71405e1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea73d65-8018-4400-940e-8ba3d53f2ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Volume 5de901cd-4f29-4864-a803-c0b2b212a382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de901cd-4f29-4864-a803-c0b2b212a382', 'volume_size': 1} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2005562130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de901cd-4f29-4864-a803-c0b2b212a382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ee174a84c54f9b8350c50b972410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:47Z,use_quota=True,user_id='68d9154ec6f94344aafb83f9613abecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Creating volume 5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:18:46 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:18:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:46 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 1073741824 Sep 30 22:18:46 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:47 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 1073741824" returned: 0 in 0.474s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:47 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 Sep 30 22:18:47 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:47 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea73d65-8018-4400-940e-8ba3d53f2ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de901cd-4f29-4864-a803-c0b2b212a382', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2192886-41f3-4509-9e5b-1373a7a7e56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Volume volume-5de901cd-4f29-4864-a803-c0b2b212a382 (5de901cd-4f29-4864-a803-c0b2b212a382): created successfully Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2192886-41f3-4509-9e5b-1373a7a7e56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (97fee3a6-8049-4386-8497-1eb7ba5bcf64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-faccf97f-1279-4848-ad93-ab64a3981e7d tempest-VolumesSnapshotTestJSON-1881800282 None] Created volume successfully. Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Creating offline snapshot 9d777355-8acc-433c-9339-59c0505c5c93 of volume 5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:18:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a44b6e-6409-4ae1-9f69-fc3fbb4b47ce]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:48 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 Sep 30 22:18:48 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:48 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382" returned: 0 in 0.434s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:48 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 1G Sep 30 22:18:48 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:48 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 1G" returned: 0 in 0.417s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5de901cd-4f29-4864-a803-c0b2b212a382 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:48 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5de901cd-4f29-4864-a803-c0b2b212a382 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 Sep 30 22:18:48 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:49 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5de901cd-4f29-4864-a803-c0b2b212a382 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93" returned: 0 in 0.300s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:49 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 is being set with open permissions: ugo+rw Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:49 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 Sep 30 22:18:49 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:49 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:49 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.info Sep 30 22:18:49 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Flow 'volume_create_manager' (25401692-f586-4bca-9972-c0184bc3386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:49 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab89c04-a0a1-43ac-bb64-6a2cb35114ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.info" returned: 0 in 0.273s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:49 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.info is being set with open permissions: ugo+rw Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab89c04-a0a1-43ac-bb64-6a2cb35114ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-595282264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509f9bc6-db8f-4596-a9e1-1ef6995d0ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf230fbf81049c1bbd033c7a6157a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:50Z,use_quota=True,user_id='36fae92225304563b171c0e830b98012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:49 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.info Sep 30 22:18:49 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9ab929-3b1b-49b5-a006-a3302c374bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9ab929-3b1b-49b5-a006-a3302c374bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fcb05b-4d5e-40cc-a749-edc8adb55252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fcb05b-4d5e-40cc-a749-edc8adb55252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509f9bc6-db8f-4596-a9e1-1ef6995d0ca2', 'volume_name': 'volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337fa62d-59e3-4452-ad17-96ca0e85c127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337fa62d-59e3-4452-ad17-96ca0e85c127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ae961b-e041-464a-b2ea-90bb29051b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Volume 509f9bc6-db8f-4596-a9e1-1ef6995d0ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2', 'volume_size': 1} Sep 30 22:18:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:50 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.info" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.208s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-595282264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509f9bc6-db8f-4596-a9e1-1ef6995d0ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf230fbf81049c1bbd033c7a6157a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:50Z,use_quota=True,user_id='36fae92225304563b171c0e830b98012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Creating volume 509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:18:50 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:50 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 1073741824 Sep 30 22:18:50 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a9380667-4d09-44f2-9a8b-bb17d59c23bc tempest-VolumesSnapshotTestJSON-1881800282 None] Create snapshot completed successfully Sep 30 22:18:50 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 1073741824" returned: 0 in 0.407s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:50 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 Sep 30 22:18:50 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:50 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ae961b-e041-464a-b2ea-90bb29051b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cc8214-c103-4b18-b891-5353a4cb091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Volume volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 (509f9bc6-db8f-4596-a9e1-1ef6995d0ca2): created successfully Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cc8214-c103-4b18-b891-5353a4cb091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Flow 'volume_create_manager' (25401692-f586-4bca-9972-c0184bc3386b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7a482088-0b72-4775-ac9a-0f560df1a1b3 tempest-VolumesServicesTestJSON-2049351237 None] Created volume successfully. Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (2e9d6488-08ae-4512-8c93-211dc368b059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268edaf8-aa92-428c-af81-00f7abd68ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268edaf8-aa92-428c-af81-00f7abd68ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-546790730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bf4689-4147-45b7-8520-6a5100bf5d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ee174a84c54f9b8350c50b972410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:18:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9d777355-8acc-433c-9339-59c0505c5c93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:18:52Z,use_quota=True,user_id='68d9154ec6f94344aafb83f9613abecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4df559-31e5-4a28-bf53-6aaa4ab41a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4df559-31e5-4a28-bf53-6aaa4ab41a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0630170c-c2e1-4bbe-8eaa-25265d306548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0630170c-c2e1-4bbe-8eaa-25265d306548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '80bf4689-4147-45b7-8520-6a5100bf5d8f', 'volume_name': 'volume-80bf4689-4147-45b7-8520-6a5100bf5d8f', 'volume_size': 2, 'snapshot_id': '9d777355-8acc-433c-9339-59c0505c5c93'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35622a9d-a5a0-4748-ac00-8fd3f2f7899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35622a9d-a5a0-4748-ac00-8fd3f2f7899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19ab075-3bd4-4060-bd3b-64905e3dc3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:18:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Volume 80bf4689-4147-45b7-8520-6a5100bf5d8f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-80bf4689-4147-45b7-8520-6a5100bf5d8f', 'volume_size': 2, 'snapshot_id': '9d777355-8acc-433c-9339-59c0505c5c93'} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-9d777355-8acc-433c-9339-59c0505c5c93-80bf4689-4147-45b7-8520-6a5100bf5d8f" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-9d777355-8acc-433c-9339-59c0505c5c93-80bf4689-4147-45b7-8520-6a5100bf5d8f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Creating volume 80bf4689-4147-45b7-8520-6a5100bf5d8f from snapshot 9d777355-8acc-433c-9339-59c0505c5c93 {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-80bf4689-4147-45b7-8520-6a5100bf5d8f" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-80bf4689-4147-45b7-8520-6a5100bf5d8f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] snapshot: 9d777355-8acc-433c-9339-59c0505c5c93, volume: 80bf4689-4147-45b7-8520-6a5100bf5d8f, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67ec505-8ce3-4647-8b94-e623d8d43cf3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:51 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 Sep 30 22:18:51 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Acquiring lock "cinder-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Lock "cinder-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Acquiring lock "cinder-quobyte-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Lock "cinder-quobyte-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecafca15-72f5-440d-b02b-03465bea28d1]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:52 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93" returned: 0 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5de901cd-4f29-4864-a803-c0b2b212a382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb9b1e4-c62f-4cd3-a1ef-42556954f459]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:52 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 Sep 30 22:18:52 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:52 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 Sep 30 22:18:52 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:52 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2" returned: 0 in 0.369s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:52 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2 Sep 30 22:18:52 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:52 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382" returned: 0 in 0.380s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:52 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f Sep 30 22:18:52 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:52 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2" returned: 0 in 0.251s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Lock "cinder-quobyte-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2" released by "delete_volume" :: held 0.669s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Created reservations ['9df8cb2d-a4cc-48c8-8481-a0b2f0be3923', 'c7fbdec5-c443-4c35-99d6-16cbc16a7b14', '1ae07f8e-4663-478d-b459-166bb3c43af5', '2be28a03-473e-4408-9322-fa2a91f8d843'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:18:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:18:52 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:18:52 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:18:53 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 30 22:18:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.333s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:18:53 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:18:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Deleted volume successfully. Sep 30 22:18:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf553515-59d2-4346-b434-04a81fe3fc49 tempest-VolumesServicesTestJSON-2049351237 None] Lock "cinder-509f9bc6-db8f-4596-a9e1-1ef6995d0ca2-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:00 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f" returned: 0 in 7.509s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382, size 1024.00 MB, duration 7.51 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:19:00 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Converted 1024.00 MB image at 136.35 MB/s Sep 30 22:19:00 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f is being set with open permissions: ugo+rw Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:00 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f Sep 30 22:19:00 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:00 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-80bf4689-4147-45b7-8520-6a5100bf5d8f" released by "_copy_volume_from_snapshot" :: held 8.620s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-9d777355-8acc-433c-9339-59c0505c5c93-80bf4689-4147-45b7-8520-6a5100bf5d8f" released by "_create_volume_from_snapshot" :: held 8.690s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.709s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19ab075-3bd4-4060-bd3b-64905e3dc3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bf4689-4147-45b7-8520-6a5100bf5d8f', 'volume_size': 2, 'snapshot_id': '9d777355-8acc-433c-9339-59c0505c5c93'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cc5d9a-e3be-4e30-b536-b6adddccd0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:00 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Volume volume-80bf4689-4147-45b7-8520-6a5100bf5d8f (80bf4689-4147-45b7-8520-6a5100bf5d8f): created successfully Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cc5d9a-e3be-4e30-b536-b6adddccd0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (2e9d6488-08ae-4512-8c93-211dc368b059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7af77752-81d7-46a6-8642-6bb611d170a5 tempest-VolumesSnapshotTestJSON-1881800282 None] Created volume successfully. Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-80bf4689-4147-45b7-8520-6a5100bf5d8f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-80bf4689-4147-45b7-8520-6a5100bf5d8f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-80bf4689-4147-45b7-8520-6a5100bf5d8f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-80bf4689-4147-45b7-8520-6a5100bf5d8f" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8659820d-53d5-4fe5-8952-5e1c4024cc75]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:00 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f Sep 30 22:19:00 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:01 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f" returned: 0 in 0.373s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:01 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f Sep 30 22:19:01 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:01 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-80bf4689-4147-45b7-8520-6a5100bf5d8f" returned: 0 in 0.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-80bf4689-4147-45b7-8520-6a5100bf5d8f" released by "delete_volume" :: held 0.688s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Created reservations ['17327297-c22d-4098-9ee5-3cdc54920397', '93aadc50-bfbf-4d4b-a5d4-876cfb459154', 'ab1e2509-fa70-4806-b0c0-a1b3d2fa5006', 'a5fe1b02-07f8-4a9f-bb7c-c68ec0c6c2f1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:01 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:01 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:01 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Deleted volume successfully. Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d3b7b8a9-f360-4159-9868-c5c4967d5e86 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-80bf4689-4147-45b7-8520-6a5100bf5d8f-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-9d777355-8acc-433c-9339-59c0505c5c93-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-9d777355-8acc-433c-9339-59c0505c5c93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-5de901cd-4f29-4864-a803-c0b2b212a382" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-5de901cd-4f29-4864-a803-c0b2b212a382" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-9d777355-8acc-433c-9339-59c0505c5c93" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-9d777355-8acc-433c-9339-59c0505c5c93" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Deleting offline snapshot 9d777355-8acc-433c-9339-59c0505c5c93 of volume 5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] snapshot_file for this snap is: volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71995b2-adff-484e-b647-553f54076a0a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:02 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 Sep 30 22:19:02 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Flow 'volume_create_manager' (0a324aff-d50d-4c20-843c-35a818a58103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b785c00-2969-4db9-be2f-a12e36149eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b785c00-2969-4db9-be2f-a12e36149eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1605484371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c30a03b-7c14-452f-b1d0-fca301c4472e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc74c50327be4607aae49d4aaa1ee8bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:02Z,use_quota=True,user_id='999b8a3987af41e282f3831d59c4d5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9206d562-7e6d-48b9-924d-bb873c9dd3a9),volume_type_id=9206d562-7e6d-48b9-924d-bb873c9dd3a9)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2d8fec-3a4d-4239-a9dc-f04742afea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2d8fec-3a4d-4239-a9dc-f04742afea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f227381e-0068-489b-861b-d58996b12cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f227381e-0068-489b-861b-d58996b12cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c30a03b-7c14-452f-b1d0-fca301c4472e', 'volume_name': 'volume-9c30a03b-7c14-452f-b1d0-fca301c4472e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fdea8e-cea4-4072-b7b7-d9d5a91544cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fdea8e-cea4-4072-b7b7-d9d5a91544cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae70fb2-35f4-4299-82b4-fc5203b7efa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:02 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Volume 9c30a03b-7c14-452f-b1d0-fca301c4472e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c30a03b-7c14-452f-b1d0-fca301c4472e', 'volume_size': 1} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1605484371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c30a03b-7c14-452f-b1d0-fca301c4472e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc74c50327be4607aae49d4aaa1ee8bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:02Z,use_quota=True,user_id='999b8a3987af41e282f3831d59c4d5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9206d562-7e6d-48b9-924d-bb873c9dd3a9),volume_type_id=9206d562-7e6d-48b9-924d-bb873c9dd3a9)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Creating volume 9c30a03b-7c14-452f-b1d0-fca301c4472e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:19:02 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:02 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e 1073741824 Sep 30 22:19:02 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:02 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93" returned: 0 in 0.415s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5de901cd-4f29-4864-a803-c0b2b212a382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fbcaca-2cb0-4f20-843a-03b34b25370a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:02 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 Sep 30 22:19:02 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:02 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e 1073741824" returned: 0 in 0.423s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:02 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e Sep 30 22:19:02 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:02 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382" returned: 0 in 0.542s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:02 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 Sep 30 22:19:02 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:03 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e" returned: 0 in 0.263s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae70fb2-35f4-4299-82b4-fc5203b7efa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c30a03b-7c14-452f-b1d0-fca301c4472e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1c3698-1d61-4d36-8c7e-8be3947da1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Volume volume-9c30a03b-7c14-452f-b1d0-fca301c4472e (9c30a03b-7c14-452f-b1d0-fca301c4472e): created successfully Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1c3698-1d61-4d36-8c7e-8be3947da1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Flow 'volume_create_manager' (0a324aff-d50d-4c20-843c-35a818a58103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b3e54b10-9e82-4539-8c6c-c955168ab1ae tempest-VolumeTypesAccessTest-1952769992 None] Created volume successfully. Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:03 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:03 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:03 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93" returned: 0 in 0.345s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:03 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93 Sep 30 22:19:03 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:03 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.279s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Acquiring lock "cinder-9c30a03b-7c14-452f-b1d0-fca301c4472e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Lock "cinder-9c30a03b-7c14-452f-b1d0-fca301c4472e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:03 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382.9d777355-8acc-433c-9339-59c0505c5c93" returned: 0 in 0.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Acquiring lock "cinder-quobyte-9c30a03b-7c14-452f-b1d0-fca301c4472e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-9d777355-8acc-433c-9339-59c0505c5c93" released by "_delete_snapshot" :: held 1.688s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Lock "cinder-quobyte-9c30a03b-7c14-452f-b1d0-fca301c4472e" acquired by "delete_volume" :: waited 0.046s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-5de901cd-4f29-4864-a803-c0b2b212a382" released by "delete_snapshot" :: held 1.730s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f02eac-6c8a-4f8f-b363-c27156bf4138]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Created reservations ['14090546-eccf-465a-a6cc-21ab6ef8b74b', '6b3baa4c-9ae5-4a99-aaed-04bdb537052b', 'c97cc806-8c82-4df2-a78c-635c7caeca94', '35249b6f-7eef-46a9-974f-52637b94e71f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:03 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e Sep 30 22:19:03 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Delete snapshot completed successfully. Sep 30 22:19:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fe429a1c-e877-48a5-95f0-e61b85e0949a tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-9d777355-8acc-433c-9339-59c0505c5c93-delete_snapshot" released by "delete_snapshot" :: held 1.894s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:04 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e" returned: 0 in 0.387s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:04 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e Sep 30 22:19:04 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-5de901cd-4f29-4864-a803-c0b2b212a382-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-5de901cd-4f29-4864-a803-c0b2b212a382-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-5de901cd-4f29-4864-a803-c0b2b212a382" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-5de901cd-4f29-4864-a803-c0b2b212a382" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f9a94-6f94-4879-880a-e483a634c355]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:04 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c30a03b-7c14-452f-b1d0-fca301c4472e" returned: 0 in 0.261s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Lock "cinder-quobyte-9c30a03b-7c14-452f-b1d0-fca301c4472e" released by "delete_volume" :: held 0.700s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:04 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 Sep 30 22:19:04 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:04 devstack cinder-volume[87240]: WARNING cinder.quota [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-506620684 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-506620684, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:19:04 devstack cinder-volume[87240]: WARNING cinder.quota [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-506620684 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-506620684, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Created reservations ['1f59dc71-cede-47d6-8779-3e8dd3c7e5c7', '97b718a3-d15d-4485-a3c0-54fbd7d7af19', '550b7c92-9cac-4a47-9be5-0db918009dc8', '8443de68-f5c6-4698-b0f4-719a271bec5a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:04 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:04 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:04 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:04 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382 Sep 30 22:19:04 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:04 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.265s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Deleted volume successfully. Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eeb5751e-c4f7-4ed0-a8d3-4c0c8052ead0 tempest-VolumeTypesAccessTest-1952769992 None] Lock "cinder-9c30a03b-7c14-452f-b1d0-fca301c4472e-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:04 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5de901cd-4f29-4864-a803-c0b2b212a382" returned: 0 in 0.270s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-5de901cd-4f29-4864-a803-c0b2b212a382" released by "delete_volume" :: held 0.687s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Created reservations ['ddabab07-e756-4f23-877d-972cf77596d8', '81939a19-cb91-4298-a391-105a8d8bf073', '602d4056-893a-4f56-9924-1136d4e7f0e7', 'c0fb8781-db69-47f5-b23a-3a13b31c7040'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:05 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:05 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:05 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.261s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Deleted volume successfully. Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1822b153-e21a-4113-ab82-5383248cdd0d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-5de901cd-4f29-4864-a803-c0b2b212a382-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (78134679-cef3-405b-928c-1005a8706de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fcab15-1082-4d0e-ae9f-67631b07be41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fcab15-1082-4d0e-ae9f-67631b07be41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-415769781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0a0902-fa45-43c7-bf5b-cb101c1740dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ee174a84c54f9b8350c50b972410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:06Z,use_quota=True,user_id='68d9154ec6f94344aafb83f9613abecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62241d14-66b3-46d4-9ed2-813c4ac8e82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62241d14-66b3-46d4-9ed2-813c4ac8e82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd67cf-fdfd-4819-b874-95699fea71c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd67cf-fdfd-4819-b874-95699fea71c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e0a0902-fa45-43c7-bf5b-cb101c1740dd', 'volume_name': 'volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12175c42-02dc-4b58-9c30-f32da86f4b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12175c42-02dc-4b58-9c30-f32da86f4b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6391be72-6209-436f-b833-5ba5cc7459cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Volume 1e0a0902-fa45-43c7-bf5b-cb101c1740dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd', 'volume_size': 1} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-415769781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0a0902-fa45-43c7-bf5b-cb101c1740dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ee174a84c54f9b8350c50b972410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:06Z,use_quota=True,user_id='68d9154ec6f94344aafb83f9613abecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Creating volume 1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:19:05 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:19:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:05 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd 1073741824 Sep 30 22:19:05 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:06 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd 1073741824" returned: 0 in 0.578s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:06 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd Sep 30 22:19:06 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:06 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:19:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6391be72-6209-436f-b833-5ba5cc7459cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076fbc8b-049f-47a8-9b1c-866e6f8006ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Volume volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd (1e0a0902-fa45-43c7-bf5b-cb101c1740dd): created successfully Sep 30 22:19:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076fbc8b-049f-47a8-9b1c-866e6f8006ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (78134679-cef3-405b-928c-1005a8706de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-86367900-7075-4365-8965-d5c1a75ecac7 tempest-VolumesSnapshotTestJSON-1881800282 None] Created volume successfully. Sep 30 22:19:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Creating offline snapshot b8e42c39-5656-4e3c-a19d-d703cc369738 of volume 1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:19:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd4d373-287b-4453-a39c-6d37da8897b3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:08 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd Sep 30 22:19:08 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:08 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" returned: 0 in 0.385s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:08 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 1G Sep 30 22:19:08 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:08 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 1G" returned: 0 in 0.469s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:08 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 Sep 30 22:19:08 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:09 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738" returned: 0 in 0.307s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:09 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 is being set with open permissions: ugo+rw Sep 30 22:19:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:09 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 Sep 30 22:19:09 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:09 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:09 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.info Sep 30 22:19:09 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:09 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.info" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:09 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.info is being set with open permissions: ugo+rw Sep 30 22:19:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:09 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.info Sep 30 22:19:09 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:10 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.info" returned: 0 in 0.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aed83ef8-33a0-42fc-a2ad-dc2028009e56 tempest-VolumesSnapshotTestJSON-1881800282 None] Create snapshot completed successfully Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (d6073a82-ff59-45e7-a1fc-5acd546654ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37755590-d0c1-480a-ac10-bff55913b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37755590-d0c1-480a-ac10-bff55913b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1539966980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1505400d-3184-4f8d-b032-d4c91563cd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ee174a84c54f9b8350c50b972410d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8e42c39-5656-4e3c-a19d-d703cc369738,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:12Z,use_quota=True,user_id='68d9154ec6f94344aafb83f9613abecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c4364f-6d95-449d-bfbc-3534e0ee8cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c4364f-6d95-449d-bfbc-3534e0ee8cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64993df-4b5c-4f95-ac31-11fd5b6d0bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64993df-4b5c-4f95-ac31-11fd5b6d0bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1505400d-3184-4f8d-b032-d4c91563cd2f', 'volume_name': 'volume-1505400d-3184-4f8d-b032-d4c91563cd2f', 'volume_size': 1, 'snapshot_id': 'b8e42c39-5656-4e3c-a19d-d703cc369738'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8b859c-634d-4075-b605-ca9ea014af0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8b859c-634d-4075-b605-ca9ea014af0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb8edea-762d-4020-99f6-90726711e5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Volume 1505400d-3184-4f8d-b032-d4c91563cd2f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1505400d-3184-4f8d-b032-d4c91563cd2f', 'volume_size': 1, 'snapshot_id': 'b8e42c39-5656-4e3c-a19d-d703cc369738'} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-b8e42c39-5656-4e3c-a19d-d703cc369738-1505400d-3184-4f8d-b032-d4c91563cd2f" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-b8e42c39-5656-4e3c-a19d-d703cc369738-1505400d-3184-4f8d-b032-d4c91563cd2f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Creating volume 1505400d-3184-4f8d-b032-d4c91563cd2f from snapshot b8e42c39-5656-4e3c-a19d-d703cc369738 {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-1505400d-3184-4f8d-b032-d4c91563cd2f" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-1505400d-3184-4f8d-b032-d4c91563cd2f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] snapshot: b8e42c39-5656-4e3c-a19d-d703cc369738, volume: 1505400d-3184-4f8d-b032-d4c91563cd2f, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[399318e2-1ebb-493b-922a-44a823d5bc8c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:12 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 Sep 30 22:19:12 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:12 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738" returned: 0 in 0.391s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:19:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb434b-7a3e-4d5f-b068-db8fe9a82905]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:12 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd Sep 30 22:19:12 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:12 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" returned: 0 in 0.446s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:19:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:19:12 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:19:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:12 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f Sep 30 22:19:12 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:20 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f" returned: 0 in 7.570s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:19:20 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Converted 1024.00 MB image at 135.26 MB/s Sep 30 22:19:20 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f is being set with open permissions: ugo+rw Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:20 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f Sep 30 22:19:20 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:20 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f" returned: 0 in 0.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-1505400d-3184-4f8d-b032-d4c91563cd2f" released by "_copy_volume_from_snapshot" :: held 8.773s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-b8e42c39-5656-4e3c-a19d-d703cc369738-1505400d-3184-4f8d-b032-d4c91563cd2f" released by "_create_volume_from_snapshot" :: held 8.836s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.855s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb8edea-762d-4020-99f6-90726711e5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1505400d-3184-4f8d-b032-d4c91563cd2f', 'volume_size': 1, 'snapshot_id': 'b8e42c39-5656-4e3c-a19d-d703cc369738'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d59a44c-ccf7-4b07-b783-bcf1ac212cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:20 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Volume volume-1505400d-3184-4f8d-b032-d4c91563cd2f (1505400d-3184-4f8d-b032-d4c91563cd2f): created successfully Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d59a44c-ccf7-4b07-b783-bcf1ac212cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Flow 'volume_create_manager' (d6073a82-ff59-45e7-a1fc-5acd546654ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a396ca72-1386-47e0-9749-ff30d84f94df tempest-VolumesSnapshotTestJSON-1881800282 None] Created volume successfully. Sep 30 22:19:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-1505400d-3184-4f8d-b032-d4c91563cd2f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-1505400d-3184-4f8d-b032-d4c91563cd2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-1505400d-3184-4f8d-b032-d4c91563cd2f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-1505400d-3184-4f8d-b032-d4c91563cd2f" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74978c9-ee6d-4f66-a459-312e8d2c65f9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:21 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f Sep 30 22:19:21 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:22 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f" returned: 0 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:22 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f Sep 30 22:19:22 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:22 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1505400d-3184-4f8d-b032-d4c91563cd2f" returned: 0 in 0.246s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-1505400d-3184-4f8d-b032-d4c91563cd2f" released by "delete_volume" :: held 0.680s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Created reservations ['34489ebe-cde3-434e-9fd3-c79b7c4000b5', '8685c235-13a1-47c9-a86f-232aea778e6d', '2a7c90a7-626d-4e09-a6c4-560084f4360b', '5ef52ed9-bddf-4087-bf95-b88241e8e068'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:22 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:22 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:22 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.263s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Deleted volume successfully. Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eca19646-27ea-43d2-b0b0-e414f2ea105b tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-1505400d-3184-4f8d-b032-d4c91563cd2f-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-b8e42c39-5656-4e3c-a19d-d703cc369738-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-b8e42c39-5656-4e3c-a19d-d703cc369738-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-b8e42c39-5656-4e3c-a19d-d703cc369738" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-b8e42c39-5656-4e3c-a19d-d703cc369738" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Deleting offline snapshot b8e42c39-5656-4e3c-a19d-d703cc369738 of volume 1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:19:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] snapshot_file for this snap is: volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:19:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6790e8ba-ad4e-4961-887b-04e9955f0cfc]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:23 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 Sep 30 22:19:23 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:23 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738" returned: 0 in 0.414s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:19:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b911b43-a7a9-4838-b6c5-ced16f18d419]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:23 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd Sep 30 22:19:23 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:23 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" returned: 0 in 0.529s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:24 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 Sep 30 22:19:24 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:24 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738" returned: 0 in 0.509s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:24 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738 Sep 30 22:19:24 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:24 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd.b8e42c39-5656-4e3c-a19d-d703cc369738" returned: 0 in 0.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=107,cinder:SELECT=94,cinder:INSERT=29,cinder:DELETE=10 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:19:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=86,cinder:INSERT=23,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:19:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-b8e42c39-5656-4e3c-a19d-d703cc369738" released by "_delete_snapshot" :: held 1.837s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" released by "delete_snapshot" :: held 1.871s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Created reservations ['5f0eb562-181c-4bbd-864b-3fb9b5aa0559', '5e613bad-9726-4b64-8d6a-9bf9a567c72b', '301ba7ec-adfb-4e49-a087-fc42887c8f6f', 'b2da519b-daa9-4998-a3f8-29d92ac7970b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Delete snapshot completed successfully. Sep 30 22:19:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31a5fccf-0e85-473b-b23f-f7d326967a6c tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-b8e42c39-5656-4e3c-a19d-d703cc369738-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-1e0a0902-fa45-43c7-bf5b-cb101c1740dd-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-1e0a0902-fa45-43c7-bf5b-cb101c1740dd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4019a1cc-e520-4f34-ad49-7116eadf106b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:25 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd Sep 30 22:19:25 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:25 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" returned: 0 in 0.416s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:25 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd Sep 30 22:19:25 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:26 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" returned: 0 in 0.294s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-1e0a0902-fa45-43c7-bf5b-cb101c1740dd" released by "delete_volume" :: held 0.792s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Created reservations ['924f82ca-5078-4e4d-9626-303e0b2db846', '84e876ad-2868-4e8a-ab08-6f4efc98bc22', 'e83b47e2-9de1-4d27-b7d1-c47d18a3ee04', '652f63f2-234e-47a8-955e-9ce3bc5738f2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:26 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:26 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-93d9ae74-3e9d-4f15-b374-740a315872a8-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:26 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-93d9ae74-3e9d-4f15-b374-740a315872a8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.312s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Deleted volume successfully. Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "cinder-quobyte-93d9ae74-3e9d-4f15-b374-740a315872a8" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-416da318-a40a-41de-9b61-c78a2b6155f1 tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-1e0a0902-fa45-43c7-bf5b-cb101c1740dd-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-93d9ae74-3e9d-4f15-b374-740a315872a8" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39caecd-95cf-4349-b885-b695b299534e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:26 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 Sep 30 22:19:26 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:27 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8" returned: 0 in 0.431s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:27 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8 Sep 30 22:19:27 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:27 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-93d9ae74-3e9d-4f15-b374-740a315872a8" returned: 0 in 0.300s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-quobyte-93d9ae74-3e9d-4f15-b374-740a315872a8" released by "delete_volume" :: held 0.814s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Created reservations ['d820f113-28ec-43eb-82a7-ffdf7d8b8149', 'c89a1fe2-0d9d-4545-8379-57f313764d01', '2448880e-0785-48ad-865b-3e354df8493d', '8c2f5d13-fdd8-4aa3-930b-c0158df4da44'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:27 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:27 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:27 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.341s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Deleted volume successfully. Sep 30 22:19:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ba78b787-0e3c-4bd4-a811-6760330fed2d tempest-VolumesSnapshotTestJSON-1881800282 None] Lock "cinder-93d9ae74-3e9d-4f15-b374-740a315872a8-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Flow 'volume_create_manager' (9b49e903-80bf-4cb9-80c1-3ad551df5709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b06ca54-07c7-487f-b483-08f1faff1fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b06ca54-07c7-487f-b483-08f1faff1fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1515005175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68057b83-6ae0-4212-bf4b-a6bfb4feedc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a50078e8710445d4ae5a77e25d386065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:37Z,use_quota=True,user_id='68542ed7e22f411aa18b1ea80f06a89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6077d6cd-69bd-4b9c-ad1a-6eb57e65bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6077d6cd-69bd-4b9c-ad1a-6eb57e65bd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4599d128-121e-491e-bc7c-0c53c7e4ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4599d128-121e-491e-bc7c-0c53c7e4ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68057b83-6ae0-4212-bf4b-a6bfb4feedc7', 'volume_name': 'volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7', 'volume_size': 2}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fbc306-8d89-4f2d-bb01-3d9377f2a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fbc306-8d89-4f2d-bb01-3d9377f2a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6ae072-1923-471d-ab70-ada81967cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:37 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Volume 68057b83-6ae0-4212-bf4b-a6bfb4feedc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7', 'volume_size': 2} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1515005175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68057b83-6ae0-4212-bf4b-a6bfb4feedc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a50078e8710445d4ae5a77e25d386065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:37Z,use_quota=True,user_id='68542ed7e22f411aa18b1ea80f06a89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Creating volume 68057b83-6ae0-4212-bf4b-a6bfb4feedc7 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:19:37 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:19:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 2147483648 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:37 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 2147483648 Sep 30 22:19:37 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:38 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 2147483648" returned: 0 in 0.620s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:38 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 Sep 30 22:19:38 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:38 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" returned: 0 in 0.258s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:19:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6ae072-1923-471d-ab70-ada81967cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7', 'volume_size': 2}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6637eefd-34be-497d-83a8-041361cf414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Volume volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 (68057b83-6ae0-4212-bf4b-a6bfb4feedc7): created successfully Sep 30 22:19:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6637eefd-34be-497d-83a8-041361cf414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Flow 'volume_create_manager' (9b49e903-80bf-4cb9-80c1-3ad551df5709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c168bb1c-e4e4-44e6-8bb9-65600d6ddfce tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Created volume successfully. Sep 30 22:19:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Creating offline snapshot 0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c of volume 68057b83-6ae0-4212-bf4b-a6bfb4feedc7 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:19:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[048bb9a9-990b-4e11-bcd9-d71e8b73a20f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:39 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 Sep 30 22:19:39 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:40 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c 2G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:40 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c 2G Sep 30 22:19:40 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:40 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c 2G" returned: 0 in 0.534s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:40 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c Sep 30 22:19:40 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:41 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c" returned: 0 in 0.342s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:41 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c is being set with open permissions: ugo+rw Sep 30 22:19:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:41 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c Sep 30 22:19:41 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:41 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c" returned: 0 in 0.434s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:41 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.info Sep 30 22:19:41 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:41 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.info" returned: 0 in 0.278s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:41 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.info is being set with open permissions: ugo+rw Sep 30 22:19:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:41 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.info Sep 30 22:19:41 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:42 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.info" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-98ce6ade-c0cd-498d-ba06-f416b196c350 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Create snapshot completed successfully Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Acquiring lock "cinder-0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Acquiring lock "cinder-quobyte-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-quobyte-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Acquiring lock "cinder-quobyte-0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-quobyte-0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Deleting offline snapshot 0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c of volume 68057b83-6ae0-4212-bf4b-a6bfb4feedc7 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] snapshot_file for this snap is: volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35ddc88-d547-47e5-ba2a-dd9d795dd44f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:43 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c Sep 30 22:19:43 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:43 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c" returned: 0 in 0.470s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[16063f15-372a-4c5e-ba14-3e1175ec6588]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:44 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 Sep 30 22:19:44 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:44 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" returned: 0 in 0.637s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:44 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c Sep 30 22:19:44 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:44 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c" returned: 0 in 0.332s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:44 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c Sep 30 22:19:44 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:45 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7.0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-quobyte-0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c" released by "_delete_snapshot" :: held 1.898s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-quobyte-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" released by "delete_snapshot" :: held 1.923s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Created reservations ['80827d9a-6838-434b-86cf-37063d8c5007', 'e61ba17f-44ec-43ff-9916-3e47219e00de', '52855a3f-2110-4ff9-bd3d-0e402e7da017', 'a4c84c1a-de7a-487d-938a-625a7befbd2b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Delete snapshot completed successfully. Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c268471b-7df6-4b78-8207-5b6d0cf39120 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-0dd7e0bd-4a05-4b52-bb7a-60674e0bfe1c-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Acquiring lock "cinder-68057b83-6ae0-4212-bf4b-a6bfb4feedc7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-68057b83-6ae0-4212-bf4b-a6bfb4feedc7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Acquiring lock "cinder-quobyte-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-quobyte-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89e88fe-1678-492c-a6a6-d527ef396888]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:45 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 Sep 30 22:19:45 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:46 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" returned: 0 in 0.415s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:46 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7 Sep 30 22:19:46 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:46 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" returned: 0 in 0.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-quobyte-68057b83-6ae0-4212-bf4b-a6bfb4feedc7" released by "delete_volume" :: held 0.820s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Created reservations ['3ea01382-b430-4800-b6da-8ff533819941', '3aab5ae5-0547-44f3-8985-8f05d36f9723', 'f69e1856-7a53-4926-855c-4f0970b3022c', 'ca837fb8-50f1-4223-bf5b-8b609091e53f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:46 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:46 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:46 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.266s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Deleted volume successfully. Sep 30 22:19:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fbe23b00-b57a-4008-bfb2-9f3d8f462387 tempest-VolumesSnapshotNegativeTestJSON-1734063110 None] Lock "cinder-68057b83-6ae0-4212-bf4b-a6bfb4feedc7-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (fba340dd-52dc-4912-a3b8-c1d583f45fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61d59f-43ca-46f9-a292-23635aa9185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61d59f-43ca-46f9-a292-23635aa9185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1758246727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7833dea6-1d8b-4039-b286-595950453bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:48Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180120ec-5e11-4060-8c00-9888cc22856e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180120ec-5e11-4060-8c00-9888cc22856e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a16eee-9055-43f1-9824-5e923e6dd17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a16eee-9055-43f1-9824-5e923e6dd17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7833dea6-1d8b-4039-b286-595950453bb3', 'volume_name': 'volume-7833dea6-1d8b-4039-b286-595950453bb3', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648f1c42-ffd5-4279-9e18-cf3a3d2e3857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648f1c42-ffd5-4279-9e18-cf3a3d2e3857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753eba14-d0b9-4dc4-83d3-4a059b2333d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Volume 7833dea6-1d8b-4039-b286-595950453bb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7833dea6-1d8b-4039-b286-595950453bb3', 'volume_size': 1} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1758246727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7833dea6-1d8b-4039-b286-595950453bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:48Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Creating volume 7833dea6-1d8b-4039-b286-595950453bb3 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:19:48 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:48 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3 1073741824 Sep 30 22:19:48 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:48 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3 1073741824" returned: 0 in 0.583s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:48 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3 Sep 30 22:19:48 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:48 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3" returned: 0 in 0.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753eba14-d0b9-4dc4-83d3-4a059b2333d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7833dea6-1d8b-4039-b286-595950453bb3', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec8a7b0-4fbc-4957-af85-af445ef24d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Volume volume-7833dea6-1d8b-4039-b286-595950453bb3 (7833dea6-1d8b-4039-b286-595950453bb3): created successfully Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec8a7b0-4fbc-4957-af85-af445ef24d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (fba340dd-52dc-4912-a3b8-c1d583f45fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-35fb3d37-3b2d-419d-80a4-2f07287d7b25 tempest-VolumesActionsTest-693824345 None] Created volume successfully. Sep 30 22:19:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1974197e-d024-4f84-bbb6-70d15dcaa680 tempest-VolumesActionsTest-693824345 None] Acquiring lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3" by "attach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1974197e-d024-4f84-bbb6-70d15dcaa680 tempest-VolumesActionsTest-693824345 None] Lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3" acquired by "attach_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1974197e-d024-4f84-bbb6-70d15dcaa680 tempest-VolumesActionsTest-693824345 None] Attaching volume 7833dea6-1d8b-4039-b286-595950453bb3 to instance cb80fe51-b1be-4feb-9f78-fe553235608f at mountpoint /dev/vdb on host None. Sep 30 22:19:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1974197e-d024-4f84-bbb6-70d15dcaa680 tempest-VolumesActionsTest-693824345 None] Attach volume completed successfully. Sep 30 22:19:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1974197e-d024-4f84-bbb6-70d15dcaa680 tempest-VolumesActionsTest-693824345 None] Lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3" released by "attach_volume" :: held 0.100s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-214ffaee-6bcc-4599-8838-8f2bb8c997f8 tempest-VolumesActionsTest-1801168433 None] Terminate volume connection completed successfully. Sep 30 22:19:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-214ffaee-6bcc-4599-8838-8f2bb8c997f8 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3-detach_volume" by "detach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-214ffaee-6bcc-4599-8838-8f2bb8c997f8 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-214ffaee-6bcc-4599-8838-8f2bb8c997f8 tempest-VolumesActionsTest-1801168433 None] Detaching volume 7833dea6-1d8b-4039-b286-595950453bb3 from instance cb80fe51-b1be-4feb-9f78-fe553235608f. Sep 30 22:19:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-214ffaee-6bcc-4599-8838-8f2bb8c997f8 tempest-VolumesActionsTest-1801168433 None] Detach volume completed successfully. Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-214ffaee-6bcc-4599-8838-8f2bb8c997f8 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e279e1d0-f475-40f0-8a85-634a6c49832b tempest-VolumesActionsTest-693824345 None] Acquiring lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3-detach_volume" by "detach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e279e1d0-f475-40f0-8a85-634a6c49832b tempest-VolumesActionsTest-693824345 None] Lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e279e1d0-f475-40f0-8a85-634a6c49832b tempest-VolumesActionsTest-693824345 None] Volume detach called, but volume not attached. Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e279e1d0-f475-40f0-8a85-634a6c49832b tempest-VolumesActionsTest-693824345 None] Lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Acquiring lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Acquiring lock "cinder-quobyte-7833dea6-1d8b-4039-b286-595950453bb3" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Lock "cinder-quobyte-7833dea6-1d8b-4039-b286-595950453bb3" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1578b850-7873-4def-b928-b6e91fe3ae7f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:51 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3 Sep 30 22:19:51 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:52 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3" returned: 0 in 0.408s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:52 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3 Sep 30 22:19:52 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:52 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7833dea6-1d8b-4039-b286-595950453bb3" returned: 0 in 0.322s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Lock "cinder-quobyte-7833dea6-1d8b-4039-b286-595950453bb3" released by "delete_volume" :: held 0.795s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Created reservations ['d7517463-87b2-45a4-9d1d-0f4d0892bbd8', '1cc28cdf-7c60-4151-b958-7b4af848d879', '93487851-e6dc-44d3-b42b-ecf064386f60', '6dfc2218-65b2-4373-be67-7988c3c94a36'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:52 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:52 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:53 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.401s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:53 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Deleted volume successfully. Sep 30 22:19:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-211d9b48-7bee-4556-b19a-735fe0df439d tempest-VolumesActionsTest-693824345 None] Lock "cinder-7833dea6-1d8b-4039-b286-595950453bb3-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (7c893950-6d86-4335-a827-b31d1a369e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc0fe72-63f9-4c0a-849f-077d0b084e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc0fe72-63f9-4c0a-849f-077d0b084e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-347965356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b876c9e-5091-4cb9-bd81-227e72e6db61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:56Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa639259-cb6a-4964-95ba-238e93eb1d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa639259-cb6a-4964-95ba-238e93eb1d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78b16d5-e7cd-4725-9e1a-495493a3f1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78b16d5-e7cd-4725-9e1a-495493a3f1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b876c9e-5091-4cb9-bd81-227e72e6db61', 'volume_name': 'volume-0b876c9e-5091-4cb9-bd81-227e72e6db61', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e63456-de4c-475e-84c2-6f286f828cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e63456-de4c-475e-84c2-6f286f828cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a296091-69a3-4b26-bd1a-30e52ff6b438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Volume 0b876c9e-5091-4cb9-bd81-227e72e6db61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b876c9e-5091-4cb9-bd81-227e72e6db61', 'volume_size': 1} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-347965356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b876c9e-5091-4cb9-bd81-227e72e6db61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:19:56Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Creating volume 0b876c9e-5091-4cb9-bd81-227e72e6db61 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:19:56 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:19:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:56 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 1073741824 Sep 30 22:19:56 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:57 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 1073741824" returned: 0 in 0.473s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:57 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 Sep 30 22:19:57 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:57 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61" returned: 0 in 0.268s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:19:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a296091-69a3-4b26-bd1a-30e52ff6b438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b876c9e-5091-4cb9-bd81-227e72e6db61', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdeb8fa-f98a-415c-b787-13c4b1732efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:19:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Volume volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 (0b876c9e-5091-4cb9-bd81-227e72e6db61): created successfully Sep 30 22:19:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdeb8fa-f98a-415c-b787-13c4b1732efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:19:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (7c893950-6d86-4335-a827-b31d1a369e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:19:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9b08d073-b054-4625-89a0-b4ad9b1ec4ff tempest-VolumesActionsTest-693824345 None] Created volume successfully. Sep 30 22:19:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "cinder-0b876c9e-5091-4cb9-bd81-227e72e6db61-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-0b876c9e-5091-4cb9-bd81-227e72e6db61-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "cinder-quobyte-0b876c9e-5091-4cb9-bd81-227e72e6db61" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:19:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-quobyte-0b876c9e-5091-4cb9-bd81-227e72e6db61" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:19:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[779a4151-da92-44ae-9d4f-3bde7c515a1e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:19:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:58 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 Sep 30 22:19:58 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:59 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61" returned: 0 in 0.407s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:59 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61 Sep 30 22:19:59 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:59 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0b876c9e-5091-4cb9-bd81-227e72e6db61" returned: 0 in 0.274s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-quobyte-0b876c9e-5091-4cb9-bd81-227e72e6db61" released by "delete_volume" :: held 0.733s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Created reservations ['d63c41ca-c31f-4bb6-a720-8696f0f701b8', 'a475ccbb-3705-4be7-82de-fd90128ecbd4', '3b1966e5-c2a3-4d23-a83e-e484231f4e95', '1e482e31-70f4-4425-9056-c2ba03f096e7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:19:59 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:19:59 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:19:59 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.307s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:19:59 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Deleted volume successfully. Sep 30 22:19:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a64052a-bd48-4f3e-b02e-15222df21243 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-0b876c9e-5091-4cb9-bd81-227e72e6db61-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (b7cde608-e011-4e3c-add9-3d8a51a9e8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ea18e2-3344-4536-b48e-8b36ec495e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ea18e2-3344-4536-b48e-8b36ec495e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-854902793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6490ba-075d-49ed-9627-751264299e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:00Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8300093-0b2f-43c9-8245-420d28dcda05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8300093-0b2f-43c9-8245-420d28dcda05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c37ef9-1896-404e-bb73-d4d299ffdac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c37ef9-1896-404e-bb73-d4d299ffdac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6490ba-075d-49ed-9627-751264299e6d', 'volume_name': 'volume-fb6490ba-075d-49ed-9627-751264299e6d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db00e7b-c9b6-48a5-9e44-b915953e6d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db00e7b-c9b6-48a5-9e44-b915953e6d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8cdc9a-dfc5-4141-abac-f728bea8d714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:00 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Volume fb6490ba-075d-49ed-9627-751264299e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6490ba-075d-49ed-9627-751264299e6d', 'volume_size': 1} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-854902793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6490ba-075d-49ed-9627-751264299e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:00Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Creating volume fb6490ba-075d-49ed-9627-751264299e6d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:00 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:00 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d 1073741824 Sep 30 22:20:00 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:00 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d 1073741824" returned: 0 in 0.426s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:00 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d Sep 30 22:20:00 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:01 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8cdc9a-dfc5-4141-abac-f728bea8d714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6490ba-075d-49ed-9627-751264299e6d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb926797-ecec-492b-9357-c17afb3223b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:01 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Volume volume-fb6490ba-075d-49ed-9627-751264299e6d (fb6490ba-075d-49ed-9627-751264299e6d): created successfully Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb926797-ecec-492b-9357-c17afb3223b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (b7cde608-e011-4e3c-add9-3d8a51a9e8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8d861625-4c5b-4882-9253-04a2df8b7f60 tempest-VolumesActionsTest-693824345 None] Created volume successfully. Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "cinder-fb6490ba-075d-49ed-9627-751264299e6d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-fb6490ba-075d-49ed-9627-751264299e6d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "cinder-quobyte-fb6490ba-075d-49ed-9627-751264299e6d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-quobyte-fb6490ba-075d-49ed-9627-751264299e6d" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeb2759-4cd9-42dd-9356-dfd2aac82af8]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:20:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:01 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d Sep 30 22:20:01 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-89eb02dd-d167-4ed8-8ed8-736d7bfd80f6 req-0701d592-9152-466a-b421-f8d3b530d46b tempest-AttachVolumeTestJSON-954727949 None] Terminate volume connection completed successfully. Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-89eb02dd-d167-4ed8-8ed8-736d7bfd80f6 req-0701d592-9152-466a-b421-f8d3b530d46b tempest-AttachVolumeTestJSON-954727949 None] Deleting attachment d2421890-b4b9-40f6-a4aa-610ac9482def. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:20:02 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d" returned: 0 in 0.526s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:02 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d Sep 30 22:20:02 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:02 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-fb6490ba-075d-49ed-9627-751264299e6d" returned: 0 in 0.280s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-quobyte-fb6490ba-075d-49ed-9627-751264299e6d" released by "delete_volume" :: held 0.889s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Created reservations ['961a2e22-b0b6-41de-a32b-c94ea50d8fd5', '4009eeca-201f-45ef-b2a6-c395a76b04fe', '72bda756-3e18-4b09-95f0-da31efbf932a', 'ad8e5ea0-b982-4a5c-9738-2332adb9a072'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:02 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:20:02 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:03 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.276s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:20:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Deleted volume successfully. Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b91071f-56b7-4c38-b4e8-65ab5fbbe418 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-fb6490ba-075d-49ed-9627-751264299e6d-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:03 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:20:03 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:03 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.310s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (06254a7d-f3c6-4058-a13d-18bfa8945265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b0a50e-22d2-4f34-b426-993003bee788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b0a50e-22d2-4f34-b426-993003bee788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1317326193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e95bcb-b2ff-4dbb-843f-6cb8d8490490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:04Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c67864e-69fa-44c1-b3bf-cdcaf708cd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c67864e-69fa-44c1-b3bf-cdcaf708cd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbc0f6e-6399-462d-8ee3-d04cfe59a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbc0f6e-6399-462d-8ee3-d04cfe59a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e95bcb-b2ff-4dbb-843f-6cb8d8490490', 'volume_name': 'volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e128026e-3cd2-4968-a4cc-10a9b8046311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e128026e-3cd2-4968-a4cc-10a9b8046311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf800ea6-8678-4245-91b5-cd41a6cc65d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Volume e3e95bcb-b2ff-4dbb-843f-6cb8d8490490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490', 'volume_size': 1} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1317326193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e95bcb-b2ff-4dbb-843f-6cb8d8490490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:04Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Creating volume e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:03 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:03 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 1073741824 Sep 30 22:20:03 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:04 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 1073741824" returned: 0 in 0.536s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:04 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 Sep 30 22:20:04 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:04 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490" returned: 0 in 0.295s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf800ea6-8678-4245-91b5-cd41a6cc65d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fc6d85-83f3-4a54-af0d-86906dae407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Volume volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 (e3e95bcb-b2ff-4dbb-843f-6cb8d8490490): created successfully Sep 30 22:20:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fc6d85-83f3-4a54-af0d-86906dae407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (06254a7d-f3c6-4058-a13d-18bfa8945265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-40ba2808-c00c-48f6-82d6-432d9d8dea2d tempest-VolumesActionsTest-693824345 None] Created volume successfully. Sep 30 22:20:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "cinder-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "cinder-quobyte-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-quobyte-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7359197-6d8f-40c1-a9ba-73e509059573]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:20:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:05 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 Sep 30 22:20:05 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:06 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490" returned: 0 in 0.400s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:06 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490 Sep 30 22:20:06 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:06 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-quobyte-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490" released by "delete_volume" :: held 0.729s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Created reservations ['1fb06c8b-ff57-41b7-b6e8-61b8cb2ac714', 'e33cd1c4-d6f8-478a-bed5-aaea3ac67a7d', 'af42ea13-43e5-472d-9018-f22f87ee6aef', '8575bf96-66bb-47e1-b641-fe74d4ff701b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:06 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:20:06 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:07 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.367s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:20:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Deleted volume successfully. Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9b58c88c-f5a9-414e-901b-33b232bbb206 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-e3e95bcb-b2ff-4dbb-843f-6cb8d8490490-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (f51b3368-6a51-4a26-856f-2fa82cf250d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d021bbc5-e9c4-441c-9b28-689bcbd8ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d021bbc5-e9c4-441c-9b28-689bcbd8ba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600848249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc8c305-fb6d-4d1b-97bc-5d250cd649f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:08Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee99395-a703-4e81-8677-bc6703712ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee99395-a703-4e81-8677-bc6703712ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f99c292-2b2e-4510-8729-d00b1fce5304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f99c292-2b2e-4510-8729-d00b1fce5304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc8c305-fb6d-4d1b-97bc-5d250cd649f5', 'volume_name': 'volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8e888e-1a34-411a-aa38-89a3dfa49a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8e888e-1a34-411a-aa38-89a3dfa49a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b3c177-113e-4860-8d0c-fa1caa48e0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Volume bbc8c305-fb6d-4d1b-97bc-5d250cd649f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5', 'volume_size': 1} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600848249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc8c305-fb6d-4d1b-97bc-5d250cd649f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:08Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Creating volume bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:07 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:07 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 1073741824 Sep 30 22:20:07 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:08 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 1073741824" returned: 0 in 0.566s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:08 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 Sep 30 22:20:08 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:08 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5" returned: 0 in 0.380s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b3c177-113e-4860-8d0c-fa1caa48e0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38cbfc5-6b18-40ed-9f04-b4224e0ceb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Volume volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 (bbc8c305-fb6d-4d1b-97bc-5d250cd649f5): created successfully Sep 30 22:20:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38cbfc5-6b18-40ed-9f04-b4224e0ceb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (f51b3368-6a51-4a26-856f-2fa82cf250d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-cf60184a-9ff4-4012-bf3e-7b320cfde8f6 tempest-VolumesActionsTest-693824345 None] Created volume successfully. Sep 30 22:20:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "cinder-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "cinder-quobyte-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-quobyte-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b470757b-05b8-46c2-83c5-22a6d3b6595a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:10 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 Sep 30 22:20:10 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:10 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5" returned: 0 in 0.382s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:10 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5 Sep 30 22:20:10 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:10 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5" returned: 0 in 0.272s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-quobyte-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5" released by "delete_volume" :: held 0.719s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Created reservations ['46a4db50-ccc6-438d-aebf-350e3332b4d1', 'feb31d9c-34aa-41c2-adba-7588efe85f9c', '0d8005f4-9ed1-40e5-9243-565ff1003bd0', '87fef46b-a3a2-4212-9755-c6850ee7a6a9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:10 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:20:10 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:11 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.397s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:20:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Deleted volume successfully. Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fab4f93c-eb16-40e5-a355-edef7a6d26f2 tempest-VolumesActionsTest-1801168433 None] Lock "cinder-bbc8c305-fb6d-4d1b-97bc-5d250cd649f5-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (52931b1b-430d-4b5f-866c-58bc7e61643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffdf759-2460-497d-95a2-68fa6c077088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffdf759-2460-497d-95a2-68fa6c077088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-239135927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c2d465-effb-48b1-83ea-8dd695e4ea6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:12Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e7d62d-ec9d-4bfa-ba6e-2b0148ab65f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e7d62d-ec9d-4bfa-ba6e-2b0148ab65f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2903be-6a02-4078-bce1-5f8c6a08a2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2903be-6a02-4078-bce1-5f8c6a08a2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c2d465-effb-48b1-83ea-8dd695e4ea6f', 'volume_name': 'volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a11550-ff84-45c3-aeb7-635ca5956d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a11550-ff84-45c3-aeb7-635ca5956d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9051a4dc-f63f-4e0d-a244-70f45819c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Volume 70c2d465-effb-48b1-83ea-8dd695e4ea6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f', 'volume_size': 1} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-239135927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c2d465-effb-48b1-83ea-8dd695e4ea6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e70a2f2dde4243be5d74b876d55309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:12Z,use_quota=True,user_id='c7fb995a38b24343ad9d97bc9c0d91bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Creating volume 70c2d465-effb-48b1-83ea-8dd695e4ea6f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:11 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:11 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f 1073741824 Sep 30 22:20:11 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:12 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f 1073741824" returned: 0 in 0.569s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:12 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f Sep 30 22:20:12 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:12 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f" returned: 0 in 0.296s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9051a4dc-f63f-4e0d-a244-70f45819c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003be7b1-9834-4418-9dea-41e2ef3f521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Volume volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f (70c2d465-effb-48b1-83ea-8dd695e4ea6f): created successfully Sep 30 22:20:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003be7b1-9834-4418-9dea-41e2ef3f521a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Flow 'volume_create_manager' (52931b1b-430d-4b5f-866c-58bc7e61643c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8f54ac16-7797-4c59-a4b1-303bac09f2b8 tempest-VolumesActionsTest-693824345 None] Created volume successfully. Sep 30 22:20:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Acquiring lock "cinder-70c2d465-effb-48b1-83ea-8dd695e4ea6f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Lock "cinder-70c2d465-effb-48b1-83ea-8dd695e4ea6f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Acquiring lock "cinder-quobyte-70c2d465-effb-48b1-83ea-8dd695e4ea6f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Lock "cinder-quobyte-70c2d465-effb-48b1-83ea-8dd695e4ea6f" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c86a0f-f9ea-4ed0-84e9-7214e9e2ffb1]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:20:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:15 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f Sep 30 22:20:15 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:15 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f" returned: 0 in 0.602s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:15 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f Sep 30 22:20:15 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:16 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70c2d465-effb-48b1-83ea-8dd695e4ea6f" returned: 0 in 0.343s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Lock "cinder-quobyte-70c2d465-effb-48b1-83ea-8dd695e4ea6f" released by "delete_volume" :: held 1.006s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Created reservations ['588e0da2-c870-4a37-a489-f5a7112dd4e0', 'dcbc159c-cf0a-4b6c-b16b-45c33b061eb8', '0861015f-e738-42b7-8075-435b30b51d5e', '48c197ce-f8a1-42f5-a25f-70a520eacded'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:16 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:20:16 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:16 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.313s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:20:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Deleted volume successfully. Sep 30 22:20:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cfee84e5-217e-4fe9-a29d-b3cca9db80b0 tempest-VolumesActionsTest-693824345 None] Lock "cinder-70c2d465-effb-48b1-83ea-8dd695e4ea6f-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:26 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=94,cinder:INSERT=27,cinder:UPDATE=106,cinder:DELETE=9 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:20:26 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=56,cinder:INSERT=21,cinder:UPDATE=88,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:20:30 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Flow 'volume_create_manager' (0a566d1a-4482-4427-ad3e-bcbcec2b36d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74e83ea-e190-4b4f-88b7-9923088b1f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74e83ea-e190-4b4f-88b7-9923088b1f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-260876687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1601c254-26b3-4050-a265-271fca2dc24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150d8aef07bf4307b9c9c3d7049b12f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:31Z,use_quota=True,user_id='b523aaa740934aa89b2e2a1cc575ba2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52585114-df67-4246-bdd1-6223a51de065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52585114-df67-4246-bdd1-6223a51de065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46c4996-227c-48d5-a4e5-fd4076ba4e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46c4996-227c-48d5-a4e5-fd4076ba4e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1601c254-26b3-4050-a265-271fca2dc24c', 'volume_name': 'volume-1601c254-26b3-4050-a265-271fca2dc24c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa97b531-81f8-4687-b41f-b63ea7fe83ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa97b531-81f8-4687-b41f-b63ea7fe83ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1549d1fc-7719-4121-b1ef-2d11eef47f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Volume 1601c254-26b3-4050-a265-271fca2dc24c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1601c254-26b3-4050-a265-271fca2dc24c', 'volume_size': 1} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-260876687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1601c254-26b3-4050-a265-271fca2dc24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150d8aef07bf4307b9c9c3d7049b12f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:31Z,use_quota=True,user_id='b523aaa740934aa89b2e2a1cc575ba2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Creating volume 1601c254-26b3-4050-a265-271fca2dc24c {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:31 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:31 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c 1073741824 Sep 30 22:20:31 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:31 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c 1073741824" returned: 0 in 0.650s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:31 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c Sep 30 22:20:31 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:32 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c" returned: 0 in 0.337s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1549d1fc-7719-4121-b1ef-2d11eef47f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1601c254-26b3-4050-a265-271fca2dc24c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66be64e4-8893-4b49-bad2-561dd8e95911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Volume volume-1601c254-26b3-4050-a265-271fca2dc24c (1601c254-26b3-4050-a265-271fca2dc24c): created successfully Sep 30 22:20:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66be64e4-8893-4b49-bad2-561dd8e95911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Flow 'volume_create_manager' (0a566d1a-4482-4427-ad3e-bcbcec2b36d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0e57ac72-6a14-4e74-b5c8-354f1380b40b tempest-TestMinimumBasicScenario-975467263 None] Created volume successfully. Sep 30 22:20:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-cb15a9cb-f2dc-4465-bc80-741d27524cda req-b193e00d-e893-4bee-9afb-f67e4aa9a6d9 tempest-TestMinimumBasicScenario-975467263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-cb15a9cb-f2dc-4465-bc80-741d27524cda req-b193e00d-e893-4bee-9afb-f67e4aa9a6d9 tempest-TestMinimumBasicScenario-975467263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-cb15a9cb-f2dc-4465-bc80-741d27524cda req-b193e00d-e893-4bee-9afb-f67e4aa9a6d9 tempest-TestMinimumBasicScenario-975467263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-cb15a9cb-f2dc-4465-bc80-741d27524cda req-b193e00d-e893-4bee-9afb-f67e4aa9a6d9 tempest-TestMinimumBasicScenario-975467263 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-1601c254-26b3-4050-a265-271fca2dc24c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fa52000-2e9b-403c-9f47-2f770ed74950', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:20:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-cb15a9cb-f2dc-4465-bc80-741d27524cda req-b193e00d-e893-4bee-9afb-f67e4aa9a6d9 tempest-TestMinimumBasicScenario-975467263 None] attachment_update completed successfully. Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Flow 'volume_create_manager' (389e41c9-ee9d-40ac-8cac-aba592f87078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891a2caf-7b32-4fa8-84b2-f767e1fb809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891a2caf-7b32-4fa8-84b2-f767e1fb809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-891837706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec269550-59fd-4b92-94f7-0e6bb3cdff9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a7dec1b18845a9858a2de06f83653c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:38Z,use_quota=True,user_id='cbac88a1380e484ca5105f94ba1384b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278a41a0-e32e-42c0-a55b-b6ddc2e42f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278a41a0-e32e-42c0-a55b-b6ddc2e42f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c4374a-0c39-4652-9f74-1f16773e9a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c4374a-0c39-4652-9f74-1f16773e9a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec269550-59fd-4b92-94f7-0e6bb3cdff9f', 'volume_name': 'volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5f9174-a669-4c4f-abc9-1fb3561b3d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5f9174-a669-4c4f-abc9-1fb3561b3d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d51c4f-d463-4650-8e33-553e67624591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Volume ec269550-59fd-4b92-94f7-0e6bb3cdff9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f', 'volume_size': 1} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-891837706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec269550-59fd-4b92-94f7-0e6bb3cdff9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a7dec1b18845a9858a2de06f83653c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:38Z,use_quota=True,user_id='cbac88a1380e484ca5105f94ba1384b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Creating volume ec269550-59fd-4b92-94f7-0e6bb3cdff9f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:38 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:38 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f 1073741824 Sep 30 22:20:38 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:38 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f 1073741824" returned: 0 in 0.517s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:38 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f Sep 30 22:20:38 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:38 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f" returned: 0 in 0.273s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d51c4f-d463-4650-8e33-553e67624591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fbd892-01be-4593-83f9-4c3281d9d50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Volume volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f (ec269550-59fd-4b92-94f7-0e6bb3cdff9f): created successfully Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fbd892-01be-4593-83f9-4c3281d9d50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Flow 'volume_create_manager' (389e41c9-ee9d-40ac-8cac-aba592f87078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a8ad9c15-58cb-4e3b-8a04-c7ed4dd08152 tempest-VolumesListAdminTestJSON-661595043 None] Created volume successfully. Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Flow 'volume_create_manager' (387dfe11-b1e5-4c62-80aa-614ebd89a5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8f6067-3a48-4a61-826d-25230f315c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b8f6067-3a48-4a61-826d-25230f315c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-994363721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6c67af-ad8f-4215-a335-21a294c65501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a7dec1b18845a9858a2de06f83653c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:41Z,use_quota=True,user_id='cbac88a1380e484ca5105f94ba1384b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd172696-d76a-4dae-b73e-f7414ba954df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd172696-d76a-4dae-b73e-f7414ba954df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adf2368-71ce-4809-905c-b0cb37c55588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adf2368-71ce-4809-905c-b0cb37c55588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d6c67af-ad8f-4215-a335-21a294c65501', 'volume_name': 'volume-3d6c67af-ad8f-4215-a335-21a294c65501', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfe5598-9644-467c-8f01-c521f0c144f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfe5598-9644-467c-8f01-c521f0c144f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0123da1f-c686-49bf-9d8b-504625acaffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Volume 3d6c67af-ad8f-4215-a335-21a294c65501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d6c67af-ad8f-4215-a335-21a294c65501', 'volume_size': 1} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-994363721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6c67af-ad8f-4215-a335-21a294c65501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a7dec1b18845a9858a2de06f83653c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:41Z,use_quota=True,user_id='cbac88a1380e484ca5105f94ba1384b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Creating volume 3d6c67af-ad8f-4215-a335-21a294c65501 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:40 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501 1073741824 Sep 30 22:20:40 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:41 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501 1073741824" returned: 0 in 0.810s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:41 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501 Sep 30 22:20:41 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:42 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501" returned: 0 in 0.272s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0123da1f-c686-49bf-9d8b-504625acaffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6c67af-ad8f-4215-a335-21a294c65501', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c567eab3-ca92-4279-bf99-f9e624133632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Volume volume-3d6c67af-ad8f-4215-a335-21a294c65501 (3d6c67af-ad8f-4215-a335-21a294c65501): created successfully Sep 30 22:20:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c567eab3-ca92-4279-bf99-f9e624133632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Flow 'volume_create_manager' (387dfe11-b1e5-4c62-80aa-614ebd89a5bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-07fda5fe-b207-44ad-87c6-43299b5d8873 tempest-VolumesListAdminTestJSON-661595043 None] Created volume successfully. Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Flow 'volume_create_manager' (259b50eb-793c-4109-856d-c62f4bc821be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59d06ab-b84a-47f6-807c-d97aaa578554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59d06ab-b84a-47f6-807c-d97aaa578554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-134150995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0986dd34-4cc2-4e24-94c5-def7922db97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a7dec1b18845a9858a2de06f83653c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:44Z,use_quota=True,user_id='cbac88a1380e484ca5105f94ba1384b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5347d1d-f5aa-4dc8-a20f-3c351410aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5347d1d-f5aa-4dc8-a20f-3c351410aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f047504-654f-445a-b384-d91eded78b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f047504-654f-445a-b384-d91eded78b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0986dd34-4cc2-4e24-94c5-def7922db97a', 'volume_name': 'volume-0986dd34-4cc2-4e24-94c5-def7922db97a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c179922e-6c96-4a79-b495-356be8a57f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c179922e-6c96-4a79-b495-356be8a57f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e43ad94-c145-4306-b80b-b0ce873439bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:43 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Volume 0986dd34-4cc2-4e24-94c5-def7922db97a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0986dd34-4cc2-4e24-94c5-def7922db97a', 'volume_size': 1} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-134150995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0986dd34-4cc2-4e24-94c5-def7922db97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8a7dec1b18845a9858a2de06f83653c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:44Z,use_quota=True,user_id='cbac88a1380e484ca5105f94ba1384b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Creating volume 0986dd34-4cc2-4e24-94c5-def7922db97a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:43 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:43 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a 1073741824 Sep 30 22:20:43 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:44 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a 1073741824" returned: 0 in 0.464s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:44 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a Sep 30 22:20:44 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:44 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e43ad94-c145-4306-b80b-b0ce873439bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0986dd34-4cc2-4e24-94c5-def7922db97a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8a02ae-45ec-4c9c-b3e9-8ddd68aa8540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Volume volume-0986dd34-4cc2-4e24-94c5-def7922db97a (0986dd34-4cc2-4e24-94c5-def7922db97a): created successfully Sep 30 22:20:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8a02ae-45ec-4c9c-b3e9-8ddd68aa8540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Flow 'volume_create_manager' (259b50eb-793c-4109-856d-c62f4bc821be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-96727384-ba52-421b-a3b3-143a349c1e3f tempest-VolumesListAdminTestJSON-661595043 None] Created volume successfully. Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Flow 'volume_create_manager' (3de56285-f28c-4110-90ae-801a5b6b172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c50c72-e85b-4e4e-82b4-f78cd333da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c50c72-e85b-4e4e-82b4-f78cd333da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0080816-c19d-4481-9667-183ea1978210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edcf604b31944ecb3420325ea54429e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:45Z,use_quota=True,user_id='df75a619cddb44bf99618447516fe87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835adeb1-e312-4920-a091-634e6c3836ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835adeb1-e312-4920-a091-634e6c3836ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fb3a5a-d701-4e5b-aeef-d4a91b244634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fb3a5a-d701-4e5b-aeef-d4a91b244634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0080816-c19d-4481-9667-183ea1978210', 'volume_name': 'volume-d0080816-c19d-4481-9667-183ea1978210', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac096ff6-229d-4c47-990d-5093fbfb7af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac096ff6-229d-4c47-990d-5093fbfb7af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc21f9d7-cea0-4d9a-9947-56353437cfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:45 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Volume d0080816-c19d-4481-9667-183ea1978210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0080816-c19d-4481-9667-183ea1978210', 'volume_size': 1} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0080816-c19d-4481-9667-183ea1978210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6edcf604b31944ecb3420325ea54429e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:45Z,use_quota=True,user_id='df75a619cddb44bf99618447516fe87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Creating volume d0080816-c19d-4481-9667-183ea1978210 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:45 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:45 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210 1073741824 Sep 30 22:20:45 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:45 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210 1073741824" returned: 0 in 0.408s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:45 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210 Sep 30 22:20:45 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:46 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210" returned: 0 in 0.232s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc21f9d7-cea0-4d9a-9947-56353437cfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0080816-c19d-4481-9667-183ea1978210', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb07be63-2009-4aed-8d24-6a58bb385a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Volume volume-d0080816-c19d-4481-9667-183ea1978210 (d0080816-c19d-4481-9667-183ea1978210): created successfully Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb07be63-2009-4aed-8d24-6a58bb385a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Flow 'volume_create_manager' (3de56285-f28c-4110-90ae-801a5b6b172f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c60276af-35e4-4def-a2c6-2b61e1ed2a3f tempest-VolumesListAdminTestJSON-1583967103 None] Created volume successfully. Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Acquiring lock "cinder-d0080816-c19d-4481-9667-183ea1978210-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Lock "cinder-d0080816-c19d-4481-9667-183ea1978210-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Acquiring lock "cinder-quobyte-d0080816-c19d-4481-9667-183ea1978210" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Lock "cinder-quobyte-d0080816-c19d-4481-9667-183ea1978210" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c89925-0126-445c-bcaa-dbdcc6f853c5]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "cinder-0986dd34-4cc2-4e24-94c5-def7922db97a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-0986dd34-4cc2-4e24-94c5-def7922db97a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "cinder-quobyte-0986dd34-4cc2-4e24-94c5-def7922db97a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:46 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210 Sep 30 22:20:46 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-quobyte-0986dd34-4cc2-4e24-94c5-def7922db97a" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4c2ea3-ffcf-4b14-9764-7da87f440245]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:46 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a Sep 30 22:20:46 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:46 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210" returned: 0 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:46 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210 Sep 30 22:20:46 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:47 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a" returned: 0 in 0.378s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:47 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a Sep 30 22:20:47 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:47 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0080816-c19d-4481-9667-183ea1978210" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Lock "cinder-quobyte-d0080816-c19d-4481-9667-183ea1978210" released by "delete_volume" :: held 0.694s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Created reservations ['1a130bcf-e457-4048-ae57-92a0b919b084', 'afd29ae0-c97e-4568-9a50-11d202c0958a', '3581bc4c-952a-4bc9-8eb8-ade7ecc1e25d', '15af23f2-070e-4ae3-aa94-b31368190ec6'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:47 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0986dd34-4cc2-4e24-94c5-def7922db97a" returned: 0 in 0.276s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:47 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-quobyte-0986dd34-4cc2-4e24-94c5-def7922db97a" released by "delete_volume" :: held 0.704s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:47 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Created reservations ['0621d7d2-697b-4958-9c22-41622e658aa0', '10ee5179-7ee2-4ab1-9c50-f4337a9cd8d6', '9ee61f0f-871d-4c91-8ccf-a3e18a821e47', 'b0a114a7-cbe7-4f7e-9bea-da1573a288d5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:47 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:20:47 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:47 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:20:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Deleted volume successfully. Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c8d82ac9-f193-4e52-a277-39153c703e2e tempest-VolumesListAdminTestJSON-1583967103 None] Lock "cinder-d0080816-c19d-4481-9667-183ea1978210-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:47 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.306s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:20:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Deleted volume successfully. Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "cinder-3d6c67af-ad8f-4215-a335-21a294c65501-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-019fb7f9-c84c-4174-9959-80f6a2d10dd1 tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-0986dd34-4cc2-4e24-94c5-def7922db97a-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-3d6c67af-ad8f-4215-a335-21a294c65501-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "cinder-quobyte-3d6c67af-ad8f-4215-a335-21a294c65501" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-quobyte-3d6c67af-ad8f-4215-a335-21a294c65501" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4364cc1b-5703-4e0b-83b8-a18dc29f6944]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Flow 'volume_create_manager' (08a33183-8106-4723-a19c-60c1e6ca9f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a880f0-e9e3-4f2c-b1fc-098a32b1bdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a880f0-e9e3-4f2c-b1fc-098a32b1bdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1950617999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf46589-82f3-463c-b990-c1f0e1dfb969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868397739bcf4e758577e97b9bf2f146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:48Z,use_quota=True,user_id='3799820b45cb4df59d5d19f627c0a93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa73fd2-99d7-429c-a33c-42c29d0f9811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa73fd2-99d7-429c-a33c-42c29d0f9811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c1523a-23e8-48c6-9e53-544d00a999b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c1523a-23e8-48c6-9e53-544d00a999b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdf46589-82f3-463c-b990-c1f0e1dfb969', 'volume_name': 'volume-bdf46589-82f3-463c-b990-c1f0e1dfb969', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baef85b7-35ac-42c8-a4ae-51a44dbfccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baef85b7-35ac-42c8-a4ae-51a44dbfccef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefa1ac0-9e2d-4308-8bff-99cd1b9cd6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Volume bdf46589-82f3-463c-b990-c1f0e1dfb969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdf46589-82f3-463c-b990-c1f0e1dfb969', 'volume_size': 1} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1950617999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf46589-82f3-463c-b990-c1f0e1dfb969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868397739bcf4e758577e97b9bf2f146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:48Z,use_quota=True,user_id='3799820b45cb4df59d5d19f627c0a93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Creating volume bdf46589-82f3-463c-b990-c1f0e1dfb969 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:47 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:47 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501 Sep 30 22:20:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:47 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:48 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 1073741824 Sep 30 22:20:48 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:48 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501" returned: 0 in 0.370s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:48 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501 Sep 30 22:20:48 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:48 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 1073741824" returned: 0 in 0.461s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:48 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 Sep 30 22:20:48 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:48 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3d6c67af-ad8f-4215-a335-21a294c65501" returned: 0 in 0.268s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-quobyte-3d6c67af-ad8f-4215-a335-21a294c65501" released by "delete_volume" :: held 0.695s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Created reservations ['862f2ab7-6554-425a-a307-90a93e6759bc', '92432ed5-1b61-48d7-82f3-15908d6aad6b', '8b18cdba-eaa2-41ac-ad8c-ce1865254b2c', 'aaa1ca74-98c8-4827-9b13-af6e9c3c44e5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:48 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:20:48 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:48 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefa1ac0-9e2d-4308-8bff-99cd1b9cd6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf46589-82f3-463c-b990-c1f0e1dfb969', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9752c77b-c51c-4ffe-8743-4d09f8fa2480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Volume volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 (bdf46589-82f3-463c-b990-c1f0e1dfb969): created successfully Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9752c77b-c51c-4ffe-8743-4d09f8fa2480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Flow 'volume_create_manager' (08a33183-8106-4723-a19c-60c1e6ca9f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5be3053f-c08a-46fd-9d4e-6708dde35d63 tempest-AttachVolumeTestJSON-954727949 None] Created volume successfully. Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "cinder-ec269550-59fd-4b92-94f7-0e6bb3cdff9f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-ec269550-59fd-4b92-94f7-0e6bb3cdff9f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:49 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:20:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Deleted volume successfully. Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "cinder-quobyte-ec269550-59fd-4b92-94f7-0e6bb3cdff9f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aceecbb2-4b1d-4186-9e1f-ca6bef5609df tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-3d6c67af-ad8f-4215-a335-21a294c65501-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-quobyte-ec269550-59fd-4b92-94f7-0e6bb3cdff9f" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a78a02d-ec07-4b90-9075-2e19855e7504]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:49 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f Sep 30 22:20:49 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:49 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f" returned: 0 in 0.363s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:49 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f Sep 30 22:20:49 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:49 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ec269550-59fd-4b92-94f7-0e6bb3cdff9f" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-quobyte-ec269550-59fd-4b92-94f7-0e6bb3cdff9f" released by "delete_volume" :: held 0.667s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Created reservations ['eb773746-65c0-42c1-8f50-3021e3d3f241', '9f45ce71-a0d5-4864-b033-c2719776320e', '60ef5832-c105-4429-b298-1f52b2075984', '0aa001f6-8a7a-4b8f-86c4-c64de4c2f996'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:49 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:20:49 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:50 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.307s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:50 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:20:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Deleted volume successfully. Sep 30 22:20:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b0ccce53-0765-4971-a462-7fea5876e6f4 tempest-VolumesListAdminTestJSON-661595043 None] Lock "cinder-ec269550-59fd-4b92-94f7-0e6bb3cdff9f-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:20:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-e1270824-15e7-4f1f-a079-de1ac219fa36 req-c5f8771a-6980-4342-beed-1f1a5e1bc869 tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-e1270824-15e7-4f1f-a079-de1ac219fa36 req-c5f8771a-6980-4342-beed-1f1a5e1bc869 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-e1270824-15e7-4f1f-a079-de1ac219fa36 req-c5f8771a-6980-4342-beed-1f1a5e1bc869 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-e1270824-15e7-4f1f-a079-de1ac219fa36 req-c5f8771a-6980-4342-beed-1f1a5e1bc869 tempest-AttachVolumeTestJSON-954727949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-bdf46589-82f3-463c-b990-c1f0e1dfb969', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f1022fc-d0e8-4e9e-9883-ea880370d3d9', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:20:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-e1270824-15e7-4f1f-a079-de1ac219fa36 req-c5f8771a-6980-4342-beed-1f1a5e1bc869 tempest-AttachVolumeTestJSON-954727949 None] attachment_update completed successfully. Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Flow 'volume_create_manager' (bc66b871-af9f-4610-b6a6-2b0ff861a919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa270b7c-113b-4336-93ab-9c1556a60c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa270b7c-113b-4336-93ab-9c1556a60c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-855793424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a408253-2700-4785-beb7-c33fbbd43301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868397739bcf4e758577e97b9bf2f146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:54Z,use_quota=True,user_id='3799820b45cb4df59d5d19f627c0a93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcebf10-68ec-45d2-a14f-d8644d0baec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcebf10-68ec-45d2-a14f-d8644d0baec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2340250b-1c8d-4bbc-8a8f-286480c426fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2340250b-1c8d-4bbc-8a8f-286480c426fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a408253-2700-4785-beb7-c33fbbd43301', 'volume_name': 'volume-2a408253-2700-4785-beb7-c33fbbd43301', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd61aebc-ec7b-46d5-9e82-fe2aeedf2643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd61aebc-ec7b-46d5-9e82-fe2aeedf2643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5563632e-3947-40c7-ae36-d9c0d234afa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Volume 2a408253-2700-4785-beb7-c33fbbd43301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a408253-2700-4785-beb7-c33fbbd43301', 'volume_size': 1} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-855793424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a408253-2700-4785-beb7-c33fbbd43301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='868397739bcf4e758577e97b9bf2f146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:20:54Z,use_quota=True,user_id='3799820b45cb4df59d5d19f627c0a93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Creating volume 2a408253-2700-4785-beb7-c33fbbd43301 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:20:53 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:20:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:53 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301 1073741824 Sep 30 22:20:53 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:54 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301 1073741824" returned: 0 in 0.454s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:20:54 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301 Sep 30 22:20:54 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:20:54 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 30 22:20:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301" returned: 0 in 0.266s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:20:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:20:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5563632e-3947-40c7-ae36-d9c0d234afa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a408253-2700-4785-beb7-c33fbbd43301', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf2f511-73d2-4499-9b1b-5e06a9749c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:20:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Volume volume-2a408253-2700-4785-beb7-c33fbbd43301 (2a408253-2700-4785-beb7-c33fbbd43301): created successfully Sep 30 22:20:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf2f511-73d2-4499-9b1b-5e06a9749c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:20:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Flow 'volume_create_manager' (bc66b871-af9f-4610-b6a6-2b0ff861a919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:20:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6c4d41cf-5971-42c5-abaf-3142683dcf4c tempest-AttachVolumeTestJSON-954727949 None] Created volume successfully. Sep 30 22:20:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-15a40847-490e-498b-926a-c40e4fa149ad req-406a6ee7-5b94-49ec-b124-60cba8974a6a tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:20:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-15a40847-490e-498b-926a-c40e4fa149ad req-406a6ee7-5b94-49ec-b124-60cba8974a6a tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:20:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-15a40847-490e-498b-926a-c40e4fa149ad req-406a6ee7-5b94-49ec-b124-60cba8974a6a tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:20:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-15a40847-490e-498b-926a-c40e4fa149ad req-406a6ee7-5b94-49ec-b124-60cba8974a6a tempest-AttachVolumeTestJSON-954727949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-2a408253-2700-4785-beb7-c33fbbd43301', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91bdaacf-bb63-4650-b20a-5798a6683008', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:20:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-15a40847-490e-498b-926a-c40e4fa149ad req-406a6ee7-5b94-49ec-b124-60cba8974a6a tempest-AttachVolumeTestJSON-954727949 None] attachment_update completed successfully. Sep 30 22:20:59 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-111ccf63-4fa1-48ef-874d-bddda2979aaf req-9511d0d4-4370-469d-a53f-d1be0187729d tempest-AttachVolumeTestJSON-954727949 None] Terminate volume connection completed successfully. Sep 30 22:20:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-111ccf63-4fa1-48ef-874d-bddda2979aaf req-9511d0d4-4370-469d-a53f-d1be0187729d tempest-AttachVolumeTestJSON-954727949 None] Deleting attachment 6f1022fc-d0e8-4e9e-9883-ea880370d3d9. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Flow 'volume_create_manager' (1aad6d91-060c-4af4-a747-1a37b4b5cf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2092a68-3578-41f2-8216-973b55611f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2092a68-3578-41f2-8216-973b55611f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-988977391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b6ae68-389e-44c3-ba6f-8a8175cad1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27371ec9127f42639f9b0b50f688fccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:01Z,use_quota=True,user_id='afd10bab4b6245a2b3bb161d5dc19d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5f9777-3119-4fc3-8e4c-05034b57476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5f9777-3119-4fc3-8e4c-05034b57476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a331fc-9a6d-45a1-beaf-48e954134e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a331fc-9a6d-45a1-beaf-48e954134e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b6ae68-389e-44c3-ba6f-8a8175cad1ee', 'volume_name': 'volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aba2ec-11c8-44b3-a8db-eacb4a98379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aba2ec-11c8-44b3-a8db-eacb4a98379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15573990-4862-4275-92c2-82b185095669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:00 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Volume c3b6ae68-389e-44c3-ba6f-8a8175cad1ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee', 'volume_size': 1} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-988977391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b6ae68-389e-44c3-ba6f-8a8175cad1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27371ec9127f42639f9b0b50f688fccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:01Z,use_quota=True,user_id='afd10bab4b6245a2b3bb161d5dc19d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Creating volume c3b6ae68-389e-44c3-ba6f-8a8175cad1ee {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:21:00 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:21:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:00 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee 1073741824 Sep 30 22:21:00 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-63a5ab4f-71be-4a7e-a31a-293b93ade7ee req-584baffc-30d9-4689-99df-383e3316109c tempest-AttachVolumeTestJSON-954727949 None] Terminate volume connection completed successfully. Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-63a5ab4f-71be-4a7e-a31a-293b93ade7ee req-584baffc-30d9-4689-99df-383e3316109c tempest-AttachVolumeTestJSON-954727949 None] Deleting attachment 91bdaacf-bb63-4650-b20a-5798a6683008. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:21:01 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee 1073741824" returned: 0 in 0.531s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:01 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee Sep 30 22:21:01 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:01 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee" returned: 0 in 0.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15573990-4862-4275-92c2-82b185095669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f016a5-2c28-4c55-95a3-bb1c870a08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:01 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Volume volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee (c3b6ae68-389e-44c3-ba6f-8a8175cad1ee): created successfully Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f016a5-2c28-4c55-95a3-bb1c870a08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Flow 'volume_create_manager' (1aad6d91-060c-4af4-a747-1a37b4b5cf65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b4f92bbb-b2c3-4eb6-b357-246b02707e45 tempest-VolumesTransfersV357Test-1823773284 None] Created volume successfully. Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:03 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:03 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:03 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.387s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:21:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:21:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1302cd1f-9a5d-4e42-8308-5961e1819885 tempest-VolumesTransfersV357Test-871709721 None] Transfer volume completed successfully. Sep 30 22:21:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Acquiring lock "cinder-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Lock "cinder-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Acquiring lock "cinder-quobyte-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Lock "cinder-quobyte-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[138d45e6-3c34-46cb-bb4f-0870949f6a39]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:04 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee Sep 30 22:21:04 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:05 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee" returned: 0 in 0.428s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:05 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee Sep 30 22:21:05 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:05 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee" returned: 0 in 0.338s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Lock "cinder-quobyte-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee" released by "delete_volume" :: held 0.836s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Created reservations ['e514da91-a553-411d-99b0-253637719475', 'ff6acb51-230d-4278-88ce-c2853d2fab5c', '1761f8ac-c542-46dc-9120-413bf279d897', '50a93dd1-e1a0-40fb-bccb-01634afc8c46'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:05 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:05 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:06 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.417s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Deleted volume successfully. Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-98036e85-dda6-4b60-abb1-d1f6d86b11dd tempest-VolumesTransfersV357Test-1922142157 None] Lock "cinder-c3b6ae68-389e-44c3-ba6f-8a8175cad1ee-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "cinder-2a408253-2700-4785-beb7-c33fbbd43301-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-2a408253-2700-4785-beb7-c33fbbd43301-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Flow 'volume_create_manager' (e9582e97-dd89-497c-9125-16a63b80f8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb1c295-5481-4be7-adea-e4b228dc65f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb1c295-5481-4be7-adea-e4b228dc65f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-240179275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf340a2f-6fde-4797-9bb3-09cd18c70e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27371ec9127f42639f9b0b50f688fccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:07Z,use_quota=True,user_id='afd10bab4b6245a2b3bb161d5dc19d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee86f39a-dffd-416e-8ca6-f15d6c8ec46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee86f39a-dffd-416e-8ca6-f15d6c8ec46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dde6f5-fc68-44ce-b928-5a3674adb6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42dde6f5-fc68-44ce-b928-5a3674adb6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf340a2f-6fde-4797-9bb3-09cd18c70e92', 'volume_name': 'volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab50a538-2c63-4244-9b9b-04de3b98875a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab50a538-2c63-4244-9b9b-04de3b98875a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d74cbe6-ba09-4b17-944c-5a28fcea45fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Volume bf340a2f-6fde-4797-9bb3-09cd18c70e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92', 'volume_size': 1} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-240179275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf340a2f-6fde-4797-9bb3-09cd18c70e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27371ec9127f42639f9b0b50f688fccd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:07Z,use_quota=True,user_id='afd10bab4b6245a2b3bb161d5dc19d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Creating volume bf340a2f-6fde-4797-9bb3-09cd18c70e92 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:21:06 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:06 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 1073741824 Sep 30 22:21:06 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "cinder-quobyte-2a408253-2700-4785-beb7-c33fbbd43301" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-quobyte-2a408253-2700-4785-beb7-c33fbbd43301" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a5e8eb-c02d-442d-a746-15d20de41bbc]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:06 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301 Sep 30 22:21:06 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:07 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 1073741824" returned: 0 in 0.442s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:07 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301" returned: 0 in 0.407s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:07 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 Sep 30 22:21:07 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:07 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301 Sep 30 22:21:07 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:07 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92" returned: 0 in 0.251s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:07 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d74cbe6-ba09-4b17-944c-5a28fcea45fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898ead79-23fb-43e1-90bb-6a0e1f25d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a408253-2700-4785-beb7-c33fbbd43301" returned: 0 in 0.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-quobyte-2a408253-2700-4785-beb7-c33fbbd43301" released by "delete_volume" :: held 0.745s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Volume volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 (bf340a2f-6fde-4797-9bb3-09cd18c70e92): created successfully Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898ead79-23fb-43e1-90bb-6a0e1f25d876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Flow 'volume_create_manager' (e9582e97-dd89-497c-9125-16a63b80f8cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-65319e22-53b8-4dfd-a863-9e807fb86035 tempest-VolumesTransfersV357Test-1823773284 None] Created volume successfully. Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Created reservations ['8c4a1690-456c-40b2-bde2-26c75ae284df', '62d84f96-bd45-402c-8d00-6bd39899a943', '07d3c1ce-b688-4848-8bbd-0725c9b4ca6a', '0f5fabf2-d775-42ae-9794-6ae2b1301148'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:07 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:07 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "cinder-bdf46589-82f3-463c-b990-c1f0e1dfb969-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-bdf46589-82f3-463c-b990-c1f0e1dfb969-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "cinder-quobyte-bdf46589-82f3-463c-b990-c1f0e1dfb969" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-quobyte-bdf46589-82f3-463c-b990-c1f0e1dfb969" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f78656-6874-4dfb-8c5a-2cb3e7ea5779]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:08 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.309s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:08 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 Sep 30 22:21:08 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Deleted volume successfully. Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f5163fa2-1fc6-427e-b2e3-f6ad2e60c57a tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-2a408253-2700-4785-beb7-c33fbbd43301-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:08 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969" returned: 0 in 0.408s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:08 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969 Sep 30 22:21:08 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:08 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bdf46589-82f3-463c-b990-c1f0e1dfb969" returned: 0 in 0.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-quobyte-bdf46589-82f3-463c-b990-c1f0e1dfb969" released by "delete_volume" :: held 0.715s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Created reservations ['9726fc46-4eb4-405d-aee5-c865e9ac08e7', '257aa90f-5501-4726-bad7-7bd23d29fa84', 'a448b768-08b2-4dcf-ac85-b3872f362709', '9b2cfc59-f9b4-4610-99d5-9f8277472fbd'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:08 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:08 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:09 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.298s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Deleted volume successfully. Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Acquiring lock "cinder-bf340a2f-6fde-4797-9bb3-09cd18c70e92-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Lock "cinder-bf340a2f-6fde-4797-9bb3-09cd18c70e92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-db01af05-4d2f-4696-a972-e3468a6491a8 tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-bdf46589-82f3-463c-b990-c1f0e1dfb969-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "cinder-9dc06ccc-b028-4641-b556-1b056e5b0aff-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-9dc06ccc-b028-4641-b556-1b056e5b0aff-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Acquiring lock "cinder-quobyte-bf340a2f-6fde-4797-9bb3-09cd18c70e92" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Lock "cinder-quobyte-bf340a2f-6fde-4797-9bb3-09cd18c70e92" acquired by "delete_volume" :: waited 0.046s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "cinder-quobyte-9dc06ccc-b028-4641-b556-1b056e5b0aff" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2022d271-5583-403c-a6d7-54b953a1fd11]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-quobyte-9dc06ccc-b028-4641-b556-1b056e5b0aff" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2b69e-934f-46bd-82a0-a5026d0a7a89]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:09 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 Sep 30 22:21:09 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:09 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff Sep 30 22:21:09 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:09 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92" returned: 0 in 0.352s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:09 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92 Sep 30 22:21:09 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:09 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff" returned: 0 in 0.433s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:09 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff Sep 30 22:21:09 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:09 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bf340a2f-6fde-4797-9bb3-09cd18c70e92" returned: 0 in 0.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Lock "cinder-quobyte-bf340a2f-6fde-4797-9bb3-09cd18c70e92" released by "delete_volume" :: held 0.676s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:09 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Created reservations ['68b447a3-39a8-4251-99bf-0df36ceeed9a', 'e39fef96-ed8d-4f0c-a9bf-27a864f1b45d', '06c996f3-a8d9-421e-a10e-43a3611a85ab', '3213c672-d501-47d1-b5bc-20c19f219d32'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:10 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9dc06ccc-b028-4641-b556-1b056e5b0aff" returned: 0 in 0.267s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-quobyte-9dc06ccc-b028-4641-b556-1b056e5b0aff" released by "delete_volume" :: held 0.766s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:10 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:10 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Created reservations ['29412cf2-7c65-47e5-a4fd-ca6592d0bd78', 'ca756812-7785-4048-9492-f39d3916a7a0', '73224332-4220-4eae-a344-7dccdf39f34b', 'bf374e72-ddba-4473-9b0e-df2f38c72e3d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:10 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:10 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:10 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Deleted volume successfully. Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2732714-4cb5-4f40-b3f1-91984f7c740e tempest-VolumesTransfersV357Test-1922142157 None] Lock "cinder-bf340a2f-6fde-4797-9bb3-09cd18c70e92-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:10 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.385s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Deleted volume successfully. Sep 30 22:21:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bad2c51c-2a2e-4bf2-8839-26e47ec9a38c tempest-AttachVolumeTestJSON-954727949 None] Lock "cinder-9dc06ccc-b028-4641-b556-1b056e5b0aff-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:16 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:21:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Flow 'volume_create_manager' (e15b084a-ab4d-4ea9-84fb-a05759440d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55695372-f16e-4ba3-8d90-60ead73e0e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55695372-f16e-4ba3-8d90-60ead73e0e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1650121491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b69801c-f479-4163-8a3d-639461e739b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab89305a4de84e56af2616f82f17d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:17Z,use_quota=True,user_id='1154e6b824c947e5b16025514d388d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0532a985-4c56-457a-843b-2863bcd97b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0532a985-4c56-457a-843b-2863bcd97b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e26e7e-a9df-48c5-86ba-733d7d096873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e26e7e-a9df-48c5-86ba-733d7d096873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b69801c-f479-4163-8a3d-639461e739b1', 'volume_name': 'volume-2b69801c-f479-4163-8a3d-639461e739b1', 'volume_size': 2}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080c965b-eed8-441b-a98d-035af14b4bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080c965b-eed8-441b-a98d-035af14b4bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec9e630-9949-478b-85a8-f55d859f5ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:17 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Volume 2b69801c-f479-4163-8a3d-639461e739b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b69801c-f479-4163-8a3d-639461e739b1', 'volume_size': 2} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1650121491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b69801c-f479-4163-8a3d-639461e739b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab89305a4de84e56af2616f82f17d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:17Z,use_quota=True,user_id='1154e6b824c947e5b16025514d388d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Creating volume 2b69801c-f479-4163-8a3d-639461e739b1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:21:17 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1 2147483648 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:17 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1 2147483648 Sep 30 22:21:17 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:17 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1 2147483648" returned: 0 in 0.543s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:17 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1 Sep 30 22:21:17 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:17 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1" returned: 0 in 0.296s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec9e630-9949-478b-85a8-f55d859f5ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b69801c-f479-4163-8a3d-639461e739b1', 'volume_size': 2}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d2fddf-028c-4124-825d-f1263af76ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:17 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Volume volume-2b69801c-f479-4163-8a3d-639461e739b1 (2b69801c-f479-4163-8a3d-639461e739b1): created successfully Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d2fddf-028c-4124-825d-f1263af76ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Flow 'volume_create_manager' (e15b084a-ab4d-4ea9-84fb-a05759440d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a89dcfa-b282-41f8-89ff-9bb0615f79dc tempest-VolumesCloneNegativeTest-407556162 None] Created volume successfully. Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Acquiring lock "cinder-2b69801c-f479-4163-8a3d-639461e739b1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Lock "cinder-2b69801c-f479-4163-8a3d-639461e739b1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Acquiring lock "cinder-quobyte-2b69801c-f479-4163-8a3d-639461e739b1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Lock "cinder-quobyte-2b69801c-f479-4163-8a3d-639461e739b1" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[35856082-b10b-415a-baa1-beaef50b3db3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:19 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1 Sep 30 22:21:19 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b1e5d4b-57b0-4d07-9ccf-375c255bc209 tempest-BackendsCapabilitiesAdminTestsJSON-761245191 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.893783569336, 'free_capacity_gb': 1774.893783569336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87240) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3fd66776-27ae-40ba-896b-ccb098b65ced tempest-BackendsCapabilitiesAdminTestsJSON-761245191 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.893783569336, 'free_capacity_gb': 1774.893783569336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87240) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 30 22:21:19 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1" returned: 0 in 0.456s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:19 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1 Sep 30 22:21:19 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:20 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2b69801c-f479-4163-8a3d-639461e739b1" returned: 0 in 0.306s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Lock "cinder-quobyte-2b69801c-f479-4163-8a3d-639461e739b1" released by "delete_volume" :: held 0.812s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Created reservations ['f7b9b5ce-141a-4549-8c94-cc5960f93feb', '64f6a72d-69fe-46b8-963d-301d378ae7ef', '3a851242-0e93-4d5c-b368-e1b673555538', '8dcf8520-f3d0-4801-88d0-d9c6a10fb8fa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:20 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:20 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:20 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.326s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Deleted volume successfully. Sep 30 22:21:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e2f70bfc-c68d-4720-902d-40ff55abafc4 tempest-VolumesCloneNegativeTest-407556162 None] Lock "cinder-2b69801c-f479-4163-8a3d-639461e739b1-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-b2e3a6b2-361f-46eb-bfc2-e57700b5a8f8 req-d2e30ad8-167c-466a-9ad3-0ab1f9d073e2 tempest-TestMinimumBasicScenario-975467263 None] Terminate volume connection completed successfully. Sep 30 22:21:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-b2e3a6b2-361f-46eb-bfc2-e57700b5a8f8 req-d2e30ad8-167c-466a-9ad3-0ab1f9d073e2 tempest-TestMinimumBasicScenario-975467263 None] Deleting attachment 1fa52000-2e9b-403c-9f47-2f770ed74950. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:21:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Acquiring lock "cinder-1601c254-26b3-4050-a265-271fca2dc24c-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Lock "cinder-1601c254-26b3-4050-a265-271fca2dc24c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Acquiring lock "cinder-quobyte-1601c254-26b3-4050-a265-271fca2dc24c" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Lock "cinder-quobyte-1601c254-26b3-4050-a265-271fca2dc24c" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[20132e24-a832-44c5-bcf9-11e95455188a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:24 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c Sep 30 22:21:24 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:24 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c" returned: 0 in 0.434s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:24 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c Sep 30 22:21:24 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:24 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-1601c254-26b3-4050-a265-271fca2dc24c" returned: 0 in 0.284s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Lock "cinder-quobyte-1601c254-26b3-4050-a265-271fca2dc24c" released by "delete_volume" :: held 0.791s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Created reservations ['c907cbf4-153e-4869-b45b-a094f1dae9f4', 'c90d5659-b149-4806-a764-03889f3d4af8', 'cbe5f559-4e96-46fd-bbd4-09f660d38ddc', '5fb8af5a-cc20-4a28-987b-c477a3c07114'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:24 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:24 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:25 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.292s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Deleted volume successfully. Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2c4d75d3-1c94-4ff8-9872-c2cb3b2d18ed tempest-TestMinimumBasicScenario-975467263 None] Lock "cinder-1601c254-26b3-4050-a265-271fca2dc24c-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Flow 'volume_create_manager' (4f47cfc1-8786-4747-b5a4-dcc6e68690d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08417692-e8d1-4244-8455-1710fd2bc1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08417692-e8d1-4244-8455-1710fd2bc1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-709031167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b986dd-2724-430a-992c-3cac850fe3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54a80ef48a4e15bdd921910df1e410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:26Z,use_quota=True,user_id='215861671fc54edba8c2a5c26ccd23a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd04105e-b860-4b38-8aff-170562bf72f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd04105e-b860-4b38-8aff-170562bf72f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19949ef3-5768-48cb-86a9-d3a25f508374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19949ef3-5768-48cb-86a9-d3a25f508374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b986dd-2724-430a-992c-3cac850fe3e4', 'volume_name': 'volume-27b986dd-2724-430a-992c-3cac850fe3e4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f08cb72-3129-4d40-ae3e-3c0b3e1756ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f08cb72-3129-4d40-ae3e-3c0b3e1756ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc86946-9187-4bef-b0af-14f76ee185ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Volume 27b986dd-2724-430a-992c-3cac850fe3e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b986dd-2724-430a-992c-3cac850fe3e4', 'volume_size': 1} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-709031167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b986dd-2724-430a-992c-3cac850fe3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54a80ef48a4e15bdd921910df1e410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:26Z,use_quota=True,user_id='215861671fc54edba8c2a5c26ccd23a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Creating volume 27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:21:25 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:21:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:25 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 1073741824 Sep 30 22:21:25 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:26 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 1073741824" returned: 0 in 0.734s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=97,cinder:UPDATE=125,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:26 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 Sep 30 22:21:26 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:26 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4" returned: 0 in 0.343s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=103,cinder:UPDATE=124,cinder:DELETE=11,cinder:INSERT=28 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc86946-9187-4bef-b0af-14f76ee185ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b986dd-2724-430a-992c-3cac850fe3e4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30786810-5237-468d-a4b2-8e40d6dfd4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Volume volume-27b986dd-2724-430a-992c-3cac850fe3e4 (27b986dd-2724-430a-992c-3cac850fe3e4): created successfully Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30786810-5237-468d-a4b2-8e40d6dfd4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Flow 'volume_create_manager' (4f47cfc1-8786-4747-b5a4-dcc6e68690d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-886a3c4b-c5e7-41df-8ee1-47adaed1ae1d tempest-VolumesSnapshotListTestJSON-466688867 None] Created volume successfully. Sep 30 22:21:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a6703731-e0c5-4e3d-b4eb-9020fd084526 tempest-GroupSnapshotsTest-1018021155 None] Group tempest-GroupSnapshotsTest-Group-1887744614: creating Sep 30 22:21:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a6703731-e0c5-4e3d-b4eb-9020fd084526 tempest-GroupSnapshotsTest-1018021155 None] Group tempest-GroupSnapshotsTest-Group-1887744614: created successfully Sep 30 22:21:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a6703731-e0c5-4e3d-b4eb-9020fd084526 tempest-GroupSnapshotsTest-1018021155 None] Create group completed successfully. Sep 30 22:21:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Creating offline snapshot 1e7a0488-d1cd-4eb0-acc0-a05781d6d586 of volume 27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:21:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc994f14-9cd4-49fd-8189-4f191c9f0164]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:28 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 Sep 30 22:21:28 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:28 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4" returned: 0 in 0.400s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:28 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 1G Sep 30 22:21:28 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:28 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 1G" returned: 0 in 0.473s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b986dd-2724-430a-992c-3cac850fe3e4 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:28 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b986dd-2724-430a-992c-3cac850fe3e4 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 Sep 30 22:21:28 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Flow 'volume_create_manager' (88a1d7c8-30e0-41a2-b4ef-c58ec48de04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25af1bd1-b222-4c4f-936a-1c7b9199fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25af1bd1-b222-4c4f-936a-1c7b9199fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2002231284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f679e91-6d41-4616-b4b6-a4fe55624683,host='devstack@QuobyteHD#QuobyteHD',id=a4fb63ca-f0c8-4119-bd1a-ec944ad9548a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866fa377b224e82967037eafe4766c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:29Z,use_quota=True,user_id='497f29a17c924569af1841513091823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27687fc1-3816-44f6-bbfd-0209a15e7e1e),volume_type_id=27687fc1-3816-44f6-bbfd-0209a15e7e1e)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1212e61e-211d-4fcd-b08e-f0f678d2d0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1212e61e-211d-4fcd-b08e-f0f678d2d0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492871a8-6084-4d52-8404-4e3f193537e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492871a8-6084-4d52-8404-4e3f193537e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fb63ca-f0c8-4119-bd1a-ec944ad9548a', 'volume_name': 'volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:29 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d59132-7ce6-41ca-a98a-460c6619e23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d59132-7ce6-41ca-a98a-460c6619e23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb092b4c-d4c1-4f65-be07-aef5364a9c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Volume a4fb63ca-f0c8-4119-bd1a-ec944ad9548a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a', 'volume_size': 1} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b986dd-2724-430a-992c-3cac850fe3e4 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586" returned: 0 in 0.384s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:29 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 is being set with open permissions: ugo+rw Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:29 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 Sep 30 22:21:29 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:29 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:29 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.info Sep 30 22:21:29 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:29 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.info" returned: 0 in 0.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:29 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.info is being set with open permissions: ugo+rw Sep 30 22:21:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:29 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.info Sep 30 22:21:29 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:30 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.info" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f679e91-6d41-4616-b4b6-a4fe55624683,created_at=2026-09-30T20:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2002231284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f679e91-6d41-4616-b4b6-a4fe55624683,host='devstack@QuobyteHD#QuobyteHD',id=a4fb63ca-f0c8-4119-bd1a-ec944ad9548a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866fa377b224e82967037eafe4766c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:29Z,use_quota=True,user_id='497f29a17c924569af1841513091823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27687fc1-3816-44f6-bbfd-0209a15e7e1e),volume_type_id=27687fc1-3816-44f6-bbfd-0209a15e7e1e)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Creating volume a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:21:30 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:30 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a 1073741824 Sep 30 22:21:30 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-68be71c6-dc17-4cd7-9ea6-34b9291ea9ef tempest-VolumesSnapshotListTestJSON-466688867 None] Create snapshot completed successfully Sep 30 22:21:30 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a 1073741824" returned: 0 in 0.489s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:30 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a Sep 30 22:21:30 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:30 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb092b4c-d4c1-4f65-be07-aef5364a9c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9334b2b5-f623-40de-940c-bf58d0e9b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Volume volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a (a4fb63ca-f0c8-4119-bd1a-ec944ad9548a): created successfully Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9334b2b5-f623-40de-940c-bf58d0e9b859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Flow 'volume_create_manager' (88a1d7c8-30e0-41a2-b4ef-c58ec48de04b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3aac0193-1725-49a5-9f44-0de46cf4ab6f tempest-GroupSnapshotsTest-1018021155 None] Created volume successfully. Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Creating offline snapshot c2c101ed-e813-422f-bd90-122d15af6790 of volume 27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1aa698-24bb-45bf-b4bd-b74c2da672f1]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:31 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 Sep 30 22:21:31 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] GroupSnapshot 065b2e40-b277-40a5-a955-e52a4efba967: creating. Sep 30 22:21:31 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586" returned: 0 in 0.492s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b986dd-2724-430a-992c-3cac850fe3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Group snapshot 065b2e40-b277-40a5-a955-e52a4efba967: creating. {{(pid=87240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 22:21:31 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 1G Sep 30 22:21:31 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:32 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 1G" returned: 0 in 0.469s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:32 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 Sep 30 22:21:32 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:32 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790" returned: 0 in 0.316s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:32 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 is being set with open permissions: ugo+rw Sep 30 22:21:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:32 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 Sep 30 22:21:32 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:32 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.649s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.043s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Creating offline snapshot 7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 of volume a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:21:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4ea970e1-67fe-49fa-9abd-729df82add9a tempest-VolumesSnapshotListTestJSON-466688867 None] Create snapshot completed successfully Sep 30 22:21:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b74949-96db-4450-bc66-0d9a318b9ecc]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:33 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a Sep 30 22:21:33 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:33 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" returned: 0 in 0.416s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:33 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 1G Sep 30 22:21:33 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:33 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 1G" returned: 0 in 0.446s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:33 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 Sep 30 22:21:33 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:34 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033" returned: 0 in 0.314s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:34 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:21:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:34 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 Sep 30 22:21:34 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:34 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:34 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.info Sep 30 22:21:34 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:34 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.info" returned: 0 in 0.269s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:34 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:21:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:34 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.info Sep 30 22:21:34 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:35 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.info" returned: 0 in 0.269s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.453s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Creating offline snapshot e19c6547-7266-4165-8cd0-55427c85babd of volume 27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:21:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a444537-6897-4488-823b-2acca8434bd3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b9a05506-feb9-4cb6-94e1-cacf4cf814c1 tempest-GroupSnapshotsTest-1018021155 None] group_snapshot 065b2e40-b277-40a5-a955-e52a4efba967: created successfully Sep 30 22:21:35 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 Sep 30 22:21:35 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:35 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790" returned: 0 in 0.354s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b986dd-2724-430a-992c-3cac850fe3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:21:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:35 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd 1G Sep 30 22:21:35 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:36 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd 1G" returned: 0 in 0.560s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:36 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd Sep 30 22:21:36 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:36 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd" returned: 0 in 0.346s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:36 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd is being set with open permissions: ugo+rw Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:36 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd Sep 30 22:21:36 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:36 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.655s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dcbfde2b-483c-41d8-8b82-8e07cfb68520 tempest-VolumesSnapshotListTestJSON-466688867 None] Create snapshot completed successfully Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-7f1c9355-bb8e-4671-83ac-d2f5f9b3e033-6d7cf484-7a0f-4861-8566-2641db26daa4" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-7f1c9355-bb8e-4671-83ac-d2f5f9b3e033-6d7cf484-7a0f-4861-8566-2641db26daa4" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Creating volume 6d7cf484-7a0f-4861-8566-2641db26daa4 from snapshot 7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-6d7cf484-7a0f-4861-8566-2641db26daa4" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-6d7cf484-7a0f-4861-8566-2641db26daa4" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] snapshot: 7f1c9355-bb8e-4671-83ac-d2f5f9b3e033, volume: 6d7cf484-7a0f-4861-8566-2641db26daa4, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f44945-7c70-4444-8030-b09413ca84ec]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:37 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 Sep 30 22:21:37 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:37 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033" returned: 0 in 0.400s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7cb1e5-52ad-4071-9ccd-f9925504995d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:37 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a Sep 30 22:21:37 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:37 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" returned: 0 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:21:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:37 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 Sep 30 22:21:37 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-e19c6547-7266-4165-8cd0-55427c85babd-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-e19c6547-7266-4165-8cd0-55427c85babd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-quobyte-e19c6547-7266-4165-8cd0-55427c85babd" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-e19c6547-7266-4165-8cd0-55427c85babd" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Deleting offline snapshot e19c6547-7266-4165-8cd0-55427c85babd of volume 27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] snapshot_file for this snap is: volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[844cece6-f1b7-417b-90a4-2cfe547243f5]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:40 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd Sep 30 22:21:40 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:40 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd" returned: 0 in 0.895s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b986dd-2724-430a-992c-3cac850fe3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:21:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b505a0a-e9ec-4703-9121-f6151aa5d1f6]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:41 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 Sep 30 22:21:41 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:41 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790" returned: 0 in 0.705s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b986dd-2724-430a-992c-3cac850fe3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:21:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:41 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd Sep 30 22:21:41 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:42 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd" returned: 0 in 0.926s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:42 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd Sep 30 22:21:42 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:43 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.e19c6547-7266-4165-8cd0-55427c85babd" returned: 0 in 0.540s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-e19c6547-7266-4165-8cd0-55427c85babd" released by "_delete_snapshot" :: held 3.286s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" released by "delete_snapshot" :: held 3.338s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Created reservations ['8156962c-14ac-401e-b665-c8d52dee7427', 'b7c1c0a3-ac05-4b38-b03e-5b7b93dad3b0', '2ad505f2-a5ba-47a9-bbde-4b5fa6d8d6cc', 'c9879498-150e-40a3-aed0-faeca60216c7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Delete snapshot completed successfully. Sep 30 22:21:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dfd991a4-22fd-4bea-8315-042dca6435da tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-e19c6547-7266-4165-8cd0-55427c85babd-delete_snapshot" released by "delete_snapshot" :: held 3.653s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-c2c101ed-e813-422f-bd90-122d15af6790-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-c2c101ed-e813-422f-bd90-122d15af6790-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-quobyte-c2c101ed-e813-422f-bd90-122d15af6790" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-c2c101ed-e813-422f-bd90-122d15af6790" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Deleting offline snapshot c2c101ed-e813-422f-bd90-122d15af6790 of volume 27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] snapshot_file for this snap is: volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac4e9c8-6217-47d4-8a7d-508e82ddd59e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:44 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 Sep 30 22:21:44 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:44 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790" returned: 0 in 0.603s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b986dd-2724-430a-992c-3cac850fe3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:21:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5845fdca-6101-4fad-b8c9-1472f84cd137]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:45 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 Sep 30 22:21:45 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:45 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586" returned: 0 in 0.693s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b986dd-2724-430a-992c-3cac850fe3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:21:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:45 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 Sep 30 22:21:45 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:46 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4" returned: 0 in 8.398s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:21:46 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Converted 1024.00 MB image at 121.91 MB/s Sep 30 22:21:46 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:46 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 Sep 30 22:21:46 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:46 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790" returned: 0 in 0.619s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:46 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790 Sep 30 22:21:46 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:46 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4" returned: 0 in 0.267s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-6d7cf484-7a0f-4861-8566-2641db26daa4" released by "_copy_volume_from_snapshot" :: held 9.601s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-7f1c9355-bb8e-4671-83ac-d2f5f9b3e033-6d7cf484-7a0f-4861-8566-2641db26daa4" released by "_create_volume_from_snapshot" :: held 9.725s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.754s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:46 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.c2c101ed-e813-422f-bd90-122d15af6790" returned: 0 in 0.282s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-c2c101ed-e813-422f-bd90-122d15af6790" released by "_delete_snapshot" :: held 2.427s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" released by "delete_snapshot" :: held 2.472s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-de9ba9e3-2dcc-45f3-9bc0-a3a8caaa7e3a tempest-GroupSnapshotsTest-1018021155 None] Create group from source-snapshot-065b2e40-b277-40a5-a955-e52a4efba967 completed successfully. Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Created reservations ['7609979a-96ee-480d-ae0b-2a4d4e1fa99d', 'c9a5aa44-009b-4e5c-97df-05d9680bce4e', 'f8f93af7-53b9-42d1-8eb2-4ce929014fe8', '20a3cf09-0c9d-433d-8154-011fbd8d9a1f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Delete snapshot completed successfully. Sep 30 22:21:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f664c15b-05ef-417a-a3dc-0b6c8781ecfe tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-c2c101ed-e813-422f-bd90-122d15af6790-delete_snapshot" released by "delete_snapshot" :: held 2.642s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-1e7a0488-d1cd-4eb0-acc0-a05781d6d586-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-1e7a0488-d1cd-4eb0-acc0-a05781d6d586-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-quobyte-1e7a0488-d1cd-4eb0-acc0-a05781d6d586" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-1e7a0488-d1cd-4eb0-acc0-a05781d6d586" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Deleting offline snapshot 1e7a0488-d1cd-4eb0-acc0-a05781d6d586 of volume 27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] snapshot_file for this snap is: volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cced0cf7-c6e7-4422-ad3d-b4f1fdc99061]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:47 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 Sep 30 22:21:47 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-6d7cf484-7a0f-4861-8566-2641db26daa4" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-6d7cf484-7a0f-4861-8566-2641db26daa4" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73dc0b1-d482-477a-aa60-b0141cbb0a7d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:47 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586" returned: 0 in 0.428s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b986dd-2724-430a-992c-3cac850fe3e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:21:47 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 Sep 30 22:21:47 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc55f805-5fbf-4066-a95f-5d92000e2c1c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:48 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 Sep 30 22:21:48 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:48 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4" returned: 0 in 0.493s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:48 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4 Sep 30 22:21:48 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:48 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4" returned: 0 in 0.488s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:48 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 Sep 30 22:21:48 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:48 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6d7cf484-7a0f-4861-8566-2641db26daa4" returned: 0 in 0.279s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-6d7cf484-7a0f-4861-8566-2641db26daa4" released by "delete_volume" :: held 0.824s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['2c2886eb-17c8-4066-9527-b8f321bfd84a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:48 devstack cinder-volume[87240]: WARNING cinder.quota [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1047118465 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1047118465, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:21:48 devstack cinder-volume[87240]: WARNING cinder.quota [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1047118465 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1047118465, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['f1fc3540-06f6-4969-9818-8cc75e2e2171', '9dbe030c-195b-4202-9efb-9ac87899680d', '0667e2dd-fa5c-4148-9b57-b3f40145661d', 'e13377b9-da24-4399-9990-a6e5db5d524c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:48 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:48 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586 Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:48 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:48 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:48 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] group_snapshot 065b2e40-b277-40a5-a955-e52a4efba967: deleting Sep 30 22:21:49 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:49 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.367s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4.1e7a0488-d1cd-4eb0-acc0-a05781d6d586" returned: 0 in 0.400s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c4ce5422-f65d-4487-ab70-2a160e814e08 tempest-GroupSnapshotsTest-1018021155 None] Delete group completed successfully. Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] group_snapshot 065b2e40-b277-40a5-a955-e52a4efba967: deleting {{(pid=87240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-1e7a0488-d1cd-4eb0-acc0-a05781d6d586" released by "_delete_snapshot" :: held 1.882s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" released by "delete_snapshot" :: held 1.916s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-7f1c9355-bb8e-4671-83ac-d2f5f9b3e033" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-7f1c9355-bb8e-4671-83ac-d2f5f9b3e033" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Deleting offline snapshot 7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 of volume a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] snapshot_file for this snap is: volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f770e7-1ff8-422f-82d7-26961733efd7]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Created reservations ['36815685-f804-4210-8970-2c6d2894db41', '04c21065-3dde-4cc4-8b7b-abdda1811122', 'bf8a2732-20e4-4470-b744-fab3f4e29928', '5ef12908-13c8-4d7c-80d6-265ef497953f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Delete snapshot completed successfully. Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1531bb5-dfcf-4f2c-a329-42671265b921 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-1e7a0488-d1cd-4eb0-acc0-a05781d6d586-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:49 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 Sep 30 22:21:49 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:49 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033" returned: 0 in 0.425s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfb9218-30b9-464b-966e-93c5a265b20a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:50 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a Sep 30 22:21:50 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:50 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" returned: 0 in 0.666s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:50 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 Sep 30 22:21:50 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-27b986dd-2724-430a-992c-3cac850fe3e4-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-27b986dd-2724-430a-992c-3cac850fe3e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fee8eab-b14b-461f-b5b5-54abe2a50bef]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:51 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 Sep 30 22:21:51 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:51 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033" returned: 0 in 0.458s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:51 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033 Sep 30 22:21:51 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:51 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4" returned: 0 in 0.462s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:51 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4 Sep 30 22:21:51 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:51 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a.7f1c9355-bb8e-4671-83ac-d2f5f9b3e033" returned: 0 in 0.342s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-7f1c9355-bb8e-4671-83ac-d2f5f9b3e033" released by "_delete_snapshot" :: held 2.077s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" released by "delete_snapshot" :: held 2.118s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:51 devstack cinder-volume[87240]: WARNING cinder.quota [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1047118465 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1047118465, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:21:51 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-27b986dd-2724-430a-992c-3cac850fe3e4" returned: 0 in 0.318s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['2145099a-0f42-4bc4-a940-878b3b483721', '8ff5b20b-d7af-4928-93a0-b33bace31147', 'ff16e643-9f47-452a-9dd1-c9af41609b89', '2692fdc9-012f-4ddd-9828-7dfa2b13765b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-quobyte-27b986dd-2724-430a-992c-3cac850fe3e4" released by "delete_volume" :: held 0.863s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-14596fc2-cfc1-4add-9134-ad74687a1c5f tempest-GroupSnapshotsTest-1018021155 None] group_snapshot 065b2e40-b277-40a5-a955-e52a4efba967: deleted successfully Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Created reservations ['ee1cd32f-cb61-49c3-8316-c7f4e991c26a', 'fdb8b1f0-0688-42e5-ad83-683d2f99a52e', '053e43a4-62a3-4452-8e89-fd1ef7951fc4', 'f96d492e-1205-46c9-97be-9a69d83996d9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:51 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:51 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:52 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.284s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:52 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Deleted volume successfully. Sep 30 22:21:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eba22748-e365-47ce-8277-460e018f9e68 tempest-VolumesSnapshotListTestJSON-466688867 None] Lock "cinder-27b986dd-2724-430a-992c-3cac850fe3e4-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:21:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:21:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b0e94-6c90-4f9f-9e44-2aff15b52971]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:21:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:53 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a Sep 30 22:21:53 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:53 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" returned: 0 in 0.465s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:53 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a Sep 30 22:21:53 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:53 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" returned: 0 in 0.370s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-a4fb63ca-f0c8-4119-bd1a-ec944ad9548a" released by "delete_volume" :: held 0.966s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['4ecbf76c-885a-40b9-a4fb-ec38929b7b67'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:54 devstack cinder-volume[87240]: WARNING cinder.db.api [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1047118465'] Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['b93575c3-eb9f-4b0d-aab5-a4bbca76fb92', '1b6cffbd-f3e9-4473-9140-babd3717beec', 'c2ab4d18-2cb6-40e3-acde-d7725af893cb', '7d024e7f-fe14-4fd1-aa5b-1a5d454e7991'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:54 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:21:54 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:54 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.328s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:54 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:21:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f5e3937e-062c-49ea-abc8-cba835c028e5 tempest-GroupSnapshotsTest-1018021155 None] Delete group completed successfully. Sep 30 22:21:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9c0a8959-b3f2-4d2d-82d5-49193ce8f568 tempest-GroupSnapshotsTest-1018021155 None] Group tempest-GroupSnapshotsTest-Group-1845223751: creating Sep 30 22:21:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9c0a8959-b3f2-4d2d-82d5-49193ce8f568 tempest-GroupSnapshotsTest-1018021155 None] Group tempest-GroupSnapshotsTest-Group-1845223751: created successfully Sep 30 22:21:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9c0a8959-b3f2-4d2d-82d5-49193ce8f568 tempest-GroupSnapshotsTest-1018021155 None] Create group completed successfully. Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Flow 'volume_create_manager' (62a63959-329f-4eda-899d-0b5e7d21564b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af45af38-de43-4191-83b3-470ae3adba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af45af38-de43-4191-83b3-470ae3adba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-908383043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a945fce-8137-4f80-ae48-64733d010eb6,host='devstack@QuobyteHD#QuobyteHD',id=728bdaeb-2f7e-43f5-88fa-a7d3ac866211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866fa377b224e82967037eafe4766c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:57Z,use_quota=True,user_id='497f29a17c924569af1841513091823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(105b2df1-5098-4044-a803-9d2777bb5837),volume_type_id=105b2df1-5098-4044-a803-9d2777bb5837)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c408120-ccb6-43fe-b886-dfbdd417df96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c408120-ccb6-43fe-b886-dfbdd417df96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d42c05-ed92-4995-9ad1-c90735de6d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d42c05-ed92-4995-9ad1-c90735de6d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728bdaeb-2f7e-43f5-88fa-a7d3ac866211', 'volume_name': 'volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25322088-5645-47a0-ac43-d752049d280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25322088-5645-47a0-ac43-d752049d280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9503757c-5f9b-411c-ace2-7b937828fcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Volume 728bdaeb-2f7e-43f5-88fa-a7d3ac866211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211', 'volume_size': 1} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a945fce-8137-4f80-ae48-64733d010eb6,created_at=2026-09-30T20:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-908383043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a945fce-8137-4f80-ae48-64733d010eb6,host='devstack@QuobyteHD#QuobyteHD',id=728bdaeb-2f7e-43f5-88fa-a7d3ac866211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866fa377b224e82967037eafe4766c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:57Z,use_quota=True,user_id='497f29a17c924569af1841513091823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(105b2df1-5098-4044-a803-9d2777bb5837),volume_type_id=105b2df1-5098-4044-a803-9d2777bb5837)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Creating volume 728bdaeb-2f7e-43f5-88fa-a7d3ac866211 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:21:57 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:21:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:57 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 1073741824 Sep 30 22:21:57 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:58 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 1073741824" returned: 0 in 0.488s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:58 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 Sep 30 22:21:58 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:21:58 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Sep 30 22:21:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" returned: 0 in 0.294s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:21:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:21:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9503757c-5f9b-411c-ace2-7b937828fcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952bc90c-9023-4952-8ad3-d0ee96b7353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:58 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Volume volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 (728bdaeb-2f7e-43f5-88fa-a7d3ac866211): created successfully Sep 30 22:21:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952bc90c-9023-4952-8ad3-d0ee96b7353a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Flow 'volume_create_manager' (62a63959-329f-4eda-899d-0b5e7d21564b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f59c2666-2456-4a2c-95fb-292cde525a7c tempest-GroupSnapshotsTest-1018021155 None] Created volume successfully. Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Flow 'volume_create_manager' (6b012680-5ce0-4c92-83ed-546b785a60fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd8c94-40a7-4944-ba59-348d537e7a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cd8c94-40a7-4944-ba59-348d537e7a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-159092663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a945fce-8137-4f80-ae48-64733d010eb6,host='devstack@QuobyteHD#QuobyteHD',id=38f621c9-744d-4ba2-a3c5-a65da061ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866fa377b224e82967037eafe4766c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:59Z,use_quota=True,user_id='497f29a17c924569af1841513091823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(105b2df1-5098-4044-a803-9d2777bb5837),volume_type_id=105b2df1-5098-4044-a803-9d2777bb5837)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6455c5db-1d58-47c0-a1c9-f42d71f90727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6455c5db-1d58-47c0-a1c9-f42d71f90727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a4694c-333c-4374-b8f3-561d52a2bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a4694c-333c-4374-b8f3-561d52a2bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f621c9-744d-4ba2-a3c5-a65da061ed92', 'volume_name': 'volume-38f621c9-744d-4ba2-a3c5-a65da061ed92', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9b16b3-d368-4032-8cdc-4e6011ade0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9b16b3-d368-4032-8cdc-4e6011ade0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868bbeca-dfec-4499-9d43-fdb7717a3a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:21:59 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Volume 38f621c9-744d-4ba2-a3c5-a65da061ed92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f621c9-744d-4ba2-a3c5-a65da061ed92', 'volume_size': 1} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a945fce-8137-4f80-ae48-64733d010eb6,created_at=2026-09-30T20:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-159092663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a945fce-8137-4f80-ae48-64733d010eb6,host='devstack@QuobyteHD#QuobyteHD',id=38f621c9-744d-4ba2-a3c5-a65da061ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866fa377b224e82967037eafe4766c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:21:59Z,use_quota=True,user_id='497f29a17c924569af1841513091823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(105b2df1-5098-4044-a803-9d2777bb5837),volume_type_id=105b2df1-5098-4044-a803-9d2777bb5837)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Creating volume 38f621c9-744d-4ba2-a3c5-a65da061ed92 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:21:59 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:21:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:21:59 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 1073741824 Sep 30 22:21:59 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:00 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 1073741824" returned: 0 in 0.649s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:00 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 Sep 30 22:22:00 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:00 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92" returned: 0 in 0.275s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:22:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868bbeca-dfec-4499-9d43-fdb7717a3a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f621c9-744d-4ba2-a3c5-a65da061ed92', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a9827c-6e7c-4c42-9a1f-1c9923c4d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:00 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Volume volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 (38f621c9-744d-4ba2-a3c5-a65da061ed92): created successfully Sep 30 22:22:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a9827c-6e7c-4c42-9a1f-1c9923c4d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Flow 'volume_create_manager' (6b012680-5ce0-4c92-83ed-546b785a60fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-996cabd7-0b2a-4ef9-a25f-fab321a60590 tempest-GroupSnapshotsTest-1018021155 None] Created volume successfully. Sep 30 22:22:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b61866a8-31ca-4b4c-afb0-f0bd53e0f7d4 tempest-GroupSnapshotsTest-1018021155 None] Update group completed successfully. Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:03 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:22:03 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-39d15da9-5bcb-49bc-9908-c0de1bf4c4be tempest-GroupSnapshotsTest-1018021155 None] Update group completed successfully. Sep 30 22:22:03 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.331s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:22:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:22:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9207a28d-40ae-4973-b7e7-e0ae626f3990 tempest-GroupSnapshotsTest-1018021155 None] Update group completed successfully. Sep 30 22:22:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1a59b289-21d1-4016-b0b5-45a5c5fd4af8 tempest-GroupSnapshotsTest-1018021155 None] Update group completed successfully. Sep 30 22:22:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] GroupSnapshot f968b3e4-a869-4624-8b04-d2df4a1cef0c: creating. Sep 30 22:22:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Group snapshot f968b3e4-a869-4624-8b04-d2df4a1cef0c: creating. {{(pid=87240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 22:22:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Creating offline snapshot 51cb3200-26fb-4ed7-91be-7686603d8f9b of volume 728bdaeb-2f7e-43f5-88fa-a7d3ac866211 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:22:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3bd07c-a99e-4b0a-b7b3-301e7f4a85f0]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:07 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 Sep 30 22:22:07 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:07 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" returned: 0 in 0.460s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:07 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b 1G Sep 30 22:22:07 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:08 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b 1G" returned: 0 in 0.615s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:08 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b Sep 30 22:22:08 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:08 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b" returned: 0 in 0.436s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:08 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:22:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:09 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b Sep 30 22:22:09 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:09 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b" returned: 0 in 0.317s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:09 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.info Sep 30 22:22:09 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:09 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.info" returned: 0 in 0.368s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:09 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:22:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:09 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.info Sep 30 22:22:09 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:09 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.info" returned: 0 in 0.303s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Creating offline snapshot 9403cf43-9177-4454-b9aa-44d460b4e8ab of volume 38f621c9-744d-4ba2-a3c5-a65da061ed92 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:22:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd8547a-c51e-4047-b33f-71ad3056907d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:10 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 Sep 30 22:22:10 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:10 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92" returned: 0 in 0.541s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:10 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab 1G Sep 30 22:22:10 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:11 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab 1G" returned: 0 in 0.533s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:11 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab Sep 30 22:22:11 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:11 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab" returned: 0 in 0.397s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:11 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:22:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:11 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab Sep 30 22:22:11 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:11 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab" returned: 0 in 0.376s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:12 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.info Sep 30 22:22:12 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:12 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.info" returned: 0 in 0.413s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:12 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:22:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:12 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.info Sep 30 22:22:12 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:12 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.info" returned: 0 in 0.512s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.938s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e1af5ba7-e72c-4f7a-9719-1a3e4d96a8dc tempest-GroupSnapshotsTest-1018021155 None] group_snapshot f968b3e4-a869-4624-8b04-d2df4a1cef0c: created successfully Sep 30 22:22:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] group_snapshot f968b3e4-a869-4624-8b04-d2df4a1cef0c: deleting Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] group_snapshot f968b3e4-a869-4624-8b04-d2df4a1cef0c: deleting {{(pid=87240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-51cb3200-26fb-4ed7-91be-7686603d8f9b" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-51cb3200-26fb-4ed7-91be-7686603d8f9b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Deleting offline snapshot 51cb3200-26fb-4ed7-91be-7686603d8f9b of volume 728bdaeb-2f7e-43f5-88fa-a7d3ac866211 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] snapshot_file for this snap is: volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[91413919-42ce-463b-9159-271a77081ec9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:14 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b Sep 30 22:22:14 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:14 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b" returned: 0 in 0.583s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7909ced-6432-4e73-a4f9-b3135e460cdc]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:15 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 Sep 30 22:22:15 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:15 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" returned: 0 in 0.611s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:15 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b Sep 30 22:22:15 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:16 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b" returned: 0 in 0.535s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:16 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b Sep 30 22:22:16 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:16 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211.51cb3200-26fb-4ed7-91be-7686603d8f9b" returned: 0 in 0.486s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-51cb3200-26fb-4ed7-91be-7686603d8f9b" released by "_delete_snapshot" :: held 2.416s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" released by "delete_snapshot" :: held 2.460s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-38f621c9-744d-4ba2-a3c5-a65da061ed92" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-38f621c9-744d-4ba2-a3c5-a65da061ed92" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-9403cf43-9177-4454-b9aa-44d460b4e8ab" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-9403cf43-9177-4454-b9aa-44d460b4e8ab" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Deleting offline snapshot 9403cf43-9177-4454-b9aa-44d460b4e8ab of volume 38f621c9-744d-4ba2-a3c5-a65da061ed92 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] snapshot_file for this snap is: volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc78eee-449d-4774-a521-881548841afa]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:17 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab Sep 30 22:22:17 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:17 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab" returned: 0 in 0.493s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38f621c9-744d-4ba2-a3c5-a65da061ed92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee1c66-ff35-4b80-87c9-8a60ea4cbd46]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:17 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 Sep 30 22:22:17 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:18 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92" returned: 0 in 0.577s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:18 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab Sep 30 22:22:18 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:18 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab" returned: 0 in 0.795s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:18 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab Sep 30 22:22:18 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:19 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92.9403cf43-9177-4454-b9aa-44d460b4e8ab" returned: 0 in 0.534s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-9403cf43-9177-4454-b9aa-44d460b4e8ab" released by "_delete_snapshot" :: held 2.600s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-38f621c9-744d-4ba2-a3c5-a65da061ed92" released by "delete_snapshot" :: held 2.646s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:19 devstack cinder-volume[87240]: WARNING cinder.quota [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1669458033 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1669458033, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:22:19 devstack cinder-volume[87240]: WARNING cinder.quota [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1669458033 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1669458033, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:22:19 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['781f85dd-0fe5-45ac-9859-8410846cdaa2', '5103e3e2-32d9-4918-b721-1039bb81e7da', 'dd681315-8f95-485b-93dd-419a85fb5eaf', '07b8552b-4d7d-48ed-9504-6336d8a49f42'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:19 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['614607e9-e488-495b-b656-667a0f2da2c4', 'c162a85a-ccc4-4db6-b7bb-2086030ff226', '39878ccc-7697-4ede-8eae-95e4024c436e', '0e11f360-f2dd-4cc0-bb16-bd3e8f7f4bd6'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2bd00d4e-2345-48c7-afee-f1940d076ade tempest-GroupSnapshotsTest-1018021155 None] group_snapshot f968b3e4-a869-4624-8b04-d2df4a1cef0c: deleted successfully Sep 30 22:22:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-38f621c9-744d-4ba2-a3c5-a65da061ed92" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-38f621c9-744d-4ba2-a3c5-a65da061ed92" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d6a15d-6ac4-4506-be15-b4951e3bdf12]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:21 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 Sep 30 22:22:21 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:21 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92" returned: 0 in 0.563s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:21 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92 Sep 30 22:22:21 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:22 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-38f621c9-744d-4ba2-a3c5-a65da061ed92" returned: 0 in 0.366s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-38f621c9-744d-4ba2-a3c5-a65da061ed92" released by "delete_volume" :: held 1.053s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec7ec03-564f-4e1b-84c9-bd80fe221f7b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:22 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 Sep 30 22:22:22 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:22 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" returned: 0 in 0.479s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:22 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211 Sep 30 22:22:22 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:23 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-728bdaeb-2f7e-43f5-88fa-a7d3ac866211" released by "delete_volume" :: held 0.993s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['f4abd3a5-e613-4671-844d-2949eda14832'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:23 devstack cinder-volume[87240]: WARNING cinder.quota [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1669458033 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1669458033, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:22:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['47f658b7-9c16-43b6-a238-72622329c7cd', '0cf27a95-00c3-417a-9432-1febf81b2578', '3da06cf3-cc8d-45f5-ae38-41d83751b9f5', '35bacecc-5a7b-4bd1-953c-7b28dacbcf5c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['e7d310fb-d6de-4aa8-8638-53b0cf5fdcd4', '43daefa4-3f9c-465e-9745-5533635e76f6', 'a8a499b1-d213-460e-8dc9-3c744738f6c9', '207c26d2-2498-4290-ac3a-a48ccf33efe8'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:22:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:22:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:24 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:22:24 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:24 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.519s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:24 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:22:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6a2382f0-2717-4c94-aaac-6c24069c9a3d tempest-GroupSnapshotsTest-1018021155 None] Delete group completed successfully. Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Flow 'volume_create_manager' (14e3b929-a865-454a-ae5b-852523dcbd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da1d480-ddc6-473d-a1c4-fba6e046b39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da1d480-ddc6-473d-a1c4-fba6e046b39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1306118435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e9a19d-6336-41bd-b814-c6c110fe625b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db869560a68a4094abc621c6817e1caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:25Z,use_quota=True,user_id='db31f38edc434dbb9b9a40919b0971cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed216eb9-70fd-4c07-a874-c75dbff3964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed216eb9-70fd-4c07-a874-c75dbff3964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221527e9-22ec-478b-9722-868cd8be81f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221527e9-22ec-478b-9722-868cd8be81f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e9a19d-6336-41bd-b814-c6c110fe625b', 'volume_name': 'volume-f1e9a19d-6336-41bd-b814-c6c110fe625b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebe2ced-ee53-4d82-aac1-d5fa1e3ee9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebe2ced-ee53-4d82-aac1-d5fa1e3ee9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10888a6d-1760-4fe0-aeb7-46fc66c90257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Volume f1e9a19d-6336-41bd-b814-c6c110fe625b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e9a19d-6336-41bd-b814-c6c110fe625b', 'volume_size': 1} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1306118435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e9a19d-6336-41bd-b814-c6c110fe625b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db869560a68a4094abc621c6817e1caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:25Z,use_quota=True,user_id='db31f38edc434dbb9b9a40919b0971cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Creating volume f1e9a19d-6336-41bd-b814-c6c110fe625b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:22:25 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:25 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b 1073741824 Sep 30 22:22:25 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:22:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Flow 'volume_create_manager' (9b761a3f-ef56-44c4-83d2-ed7fa38551be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cd6802-69d0-47cd-8d7e-ecbf623b27dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cd6802-69d0-47cd-8d7e-ecbf623b27dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-615556105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13b4817-efa1-402c-b872-0793b4aeed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db869560a68a4094abc621c6817e1caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:26Z,use_quota=True,user_id='db31f38edc434dbb9b9a40919b0971cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc270c08-1e3a-4ac8-9786-7ce026372431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc270c08-1e3a-4ac8-9786-7ce026372431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0134da0-2395-46c3-9db5-dec8d25fcbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0134da0-2395-46c3-9db5-dec8d25fcbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13b4817-efa1-402c-b872-0793b4aeed91', 'volume_name': 'volume-b13b4817-efa1-402c-b872-0793b4aeed91', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748ac8ff-c0b7-4409-823c-cc24fcb3c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748ac8ff-c0b7-4409-823c-cc24fcb3c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25897d5a-552f-4615-a30c-4c99e13f5d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Volume b13b4817-efa1-402c-b872-0793b4aeed91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13b4817-efa1-402c-b872-0793b4aeed91', 'volume_size': 1} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a712a30-00af-4ce2-91a4-cd37d8629bf8 tempest-GroupSnapshotsTest-1018021155 None] Group tempest-GroupSnapshotsTest-Group-1221078793: creating Sep 30 22:22:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a712a30-00af-4ce2-91a4-cd37d8629bf8 tempest-GroupSnapshotsTest-1018021155 None] Group tempest-GroupSnapshotsTest-Group-1221078793: created successfully Sep 30 22:22:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a712a30-00af-4ce2-91a4-cd37d8629bf8 tempest-GroupSnapshotsTest-1018021155 None] Create group completed successfully. Sep 30 22:22:26 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b 1073741824" returned: 0 in 0.645s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:26 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b Sep 30 22:22:26 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:26 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b" returned: 0 in 0.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-615556105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13b4817-efa1-402c-b872-0793b4aeed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db869560a68a4094abc621c6817e1caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:26Z,use_quota=True,user_id='db31f38edc434dbb9b9a40919b0971cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Creating volume b13b4817-efa1-402c-b872-0793b4aeed91 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:22:26 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10888a6d-1760-4fe0-aeb7-46fc66c90257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e9a19d-6336-41bd-b814-c6c110fe625b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:26 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91 1073741824 Sep 30 22:22:26 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f879d37-2cbc-4860-adf4-9381f38f36be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Volume volume-f1e9a19d-6336-41bd-b814-c6c110fe625b (f1e9a19d-6336-41bd-b814-c6c110fe625b): created successfully Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f879d37-2cbc-4860-adf4-9381f38f36be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Flow 'volume_create_manager' (14e3b929-a865-454a-ae5b-852523dcbd24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-598d5205-a486-40e2-8df0-4afaae662b73 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Created volume successfully. Sep 30 22:22:27 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91 1073741824" returned: 0 in 0.584s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=120,cinder:DELETE=3,cinder:SELECT=119,cinder:INSERT=30 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=118,cinder:UPDATE=111,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:27 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91 Sep 30 22:22:27 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:27 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91" returned: 0 in 0.502s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25897d5a-552f-4615-a30c-4c99e13f5d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13b4817-efa1-402c-b872-0793b4aeed91', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a34be68-74eb-4083-87ea-89eac0f2654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Volume volume-b13b4817-efa1-402c-b872-0793b4aeed91 (b13b4817-efa1-402c-b872-0793b4aeed91): created successfully Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a34be68-74eb-4083-87ea-89eac0f2654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Flow 'volume_create_manager' (9b761a3f-ef56-44c4-83d2-ed7fa38551be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-724d6602-e9d9-4e31-b1b0-6c770044e4dd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Created volume successfully. Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Flow 'volume_create_manager' (ce0633e9-1d59-4862-9df3-652092ba778e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81db9567-2962-402d-9b2b-60ed3d4fb031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81db9567-2962-402d-9b2b-60ed3d4fb031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720603454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51b63473-468e-4501-bcfe-00cc2992ed58,host='devstack@QuobyteHD#QuobyteHD',id=2a482bca-436f-479a-9bdb-0089e9d26d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866fa377b224e82967037eafe4766c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:28Z,use_quota=True,user_id='497f29a17c924569af1841513091823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b44ad24c-85b1-408e-a172-7ed7dcb2c925),volume_type_id=b44ad24c-85b1-408e-a172-7ed7dcb2c925)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663d0024-6625-46cc-9760-6c7c419788ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663d0024-6625-46cc-9760-6c7c419788ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e9eff4-cb1d-496d-96c2-ee3041384a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e9eff4-cb1d-496d-96c2-ee3041384a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a482bca-436f-479a-9bdb-0089e9d26d1b', 'volume_name': 'volume-2a482bca-436f-479a-9bdb-0089e9d26d1b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d82362-0616-4933-8b5e-8c0e2cc29de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d82362-0616-4933-8b5e-8c0e2cc29de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01813892-974a-4834-a298-22060953c4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Volume 2a482bca-436f-479a-9bdb-0089e9d26d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a482bca-436f-479a-9bdb-0089e9d26d1b', 'volume_size': 1} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51b63473-468e-4501-bcfe-00cc2992ed58,created_at=2026-09-30T20:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720603454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51b63473-468e-4501-bcfe-00cc2992ed58,host='devstack@QuobyteHD#QuobyteHD',id=2a482bca-436f-479a-9bdb-0089e9d26d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8866fa377b224e82967037eafe4766c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:28Z,use_quota=True,user_id='497f29a17c924569af1841513091823b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b44ad24c-85b1-408e-a172-7ed7dcb2c925),volume_type_id=b44ad24c-85b1-408e-a172-7ed7dcb2c925)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Creating volume 2a482bca-436f-479a-9bdb-0089e9d26d1b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:22:27 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:22:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:27 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b 1073741824 Sep 30 22:22:27 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:28 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b 1073741824" returned: 0 in 0.563s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:28 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b Sep 30 22:22:28 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:28 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b" returned: 0 in 0.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:22:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01813892-974a-4834-a298-22060953c4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a482bca-436f-479a-9bdb-0089e9d26d1b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f068c334-b2f8-4206-958a-d647fe0ad666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Volume volume-2a482bca-436f-479a-9bdb-0089e9d26d1b (2a482bca-436f-479a-9bdb-0089e9d26d1b): created successfully Sep 30 22:22:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f068c334-b2f8-4206-958a-d647fe0ad666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Flow 'volume_create_manager' (ce0633e9-1d59-4862-9df3-652092ba778e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-653db483-e28a-4cb7-87b7-064467dd9e20 tempest-GroupSnapshotsTest-1018021155 None] Created volume successfully. Sep 30 22:22:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] GroupSnapshot 4625af66-8c5f-4bce-b9c7-fd02bb11c6f3: creating. Sep 30 22:22:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Group snapshot 4625af66-8c5f-4bce-b9c7-fd02bb11c6f3: creating. {{(pid=87240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 30 22:22:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Creating offline snapshot a9a715c3-62d4-41d9-aae0-77284f3628fb of volume 2a482bca-436f-479a-9bdb-0089e9d26d1b {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:22:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f505d58-b12c-46c9-bbc8-c3d3488cb46a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:29 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b Sep 30 22:22:29 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:29 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b" returned: 0 in 0.426s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:29 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb 1G Sep 30 22:22:29 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:30 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb 1G" returned: 0 in 0.466s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a482bca-436f-479a-9bdb-0089e9d26d1b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:30 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a482bca-436f-479a-9bdb-0089e9d26d1b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb Sep 30 22:22:30 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:30 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a482bca-436f-479a-9bdb-0089e9d26d1b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb" returned: 0 in 0.357s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:30 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:22:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:30 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb Sep 30 22:22:30 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:30 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb" returned: 0 in 0.280s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:30 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.info Sep 30 22:22:30 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:31 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.info" returned: 0 in 0.301s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:31 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:22:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:31 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.info Sep 30 22:22:31 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:31 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.info" returned: 0 in 0.288s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e516c69a-59e3-4d4b-bca3-aee4c51ec352 tempest-GroupSnapshotsTest-1018021155 None] group_snapshot 4625af66-8c5f-4bce-b9c7-fd02bb11c6f3: created successfully Sep 30 22:22:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] group_snapshot 4625af66-8c5f-4bce-b9c7-fd02bb11c6f3: deleting Sep 30 22:22:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] group_snapshot 4625af66-8c5f-4bce-b9c7-fd02bb11c6f3: deleting {{(pid=87240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 30 22:22:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-2a482bca-436f-479a-9bdb-0089e9d26d1b" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-2a482bca-436f-479a-9bdb-0089e9d26d1b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-a9a715c3-62d4-41d9-aae0-77284f3628fb" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-a9a715c3-62d4-41d9-aae0-77284f3628fb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Deleting offline snapshot a9a715c3-62d4-41d9-aae0-77284f3628fb of volume 2a482bca-436f-479a-9bdb-0089e9d26d1b {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:22:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] snapshot_file for this snap is: volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:22:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d965f59-3264-4e4f-9093-308826720674]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:32 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb Sep 30 22:22:32 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:33 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb" returned: 0 in 0.634s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a482bca-436f-479a-9bdb-0089e9d26d1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae410272-f361-4277-a735-e15a466af869]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:33 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b Sep 30 22:22:33 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:34 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b" returned: 0 in 0.565s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:34 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb Sep 30 22:22:34 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:34 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb" returned: 0 in 0.366s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:34 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb Sep 30 22:22:34 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:34 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b.a9a715c3-62d4-41d9-aae0-77284f3628fb" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-a9a715c3-62d4-41d9-aae0-77284f3628fb" released by "_delete_snapshot" :: held 2.006s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-2a482bca-436f-479a-9bdb-0089e9d26d1b" released by "delete_snapshot" :: held 2.030s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:34 devstack cinder-volume[87240]: WARNING cinder.quota [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-945448391 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-945448391, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:22:34 devstack cinder-volume[87240]: WARNING cinder.quota [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-945448391 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-945448391, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:22:34 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['30789766-2e6c-4f84-8698-5f62e056ab59', 'fce9c01b-7744-45dc-b79f-ace58ea6423f', '1a15b2bf-62fa-4cc8-ab81-48dfb153b07c', '64c6b35f-0c90-487d-9898-c3a4bdeb0060'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fa983b61-a6c7-411c-ba8f-29612613cfce tempest-GroupSnapshotsTest-1018021155 None] group_snapshot 4625af66-8c5f-4bce-b9c7-fd02bb11c6f3: deleted successfully Sep 30 22:22:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "cinder-quobyte-2a482bca-436f-479a-9bdb-0089e9d26d1b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-2a482bca-436f-479a-9bdb-0089e9d26d1b" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9f1eb-0852-4f83-a965-5d24af6a2661]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:35 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b Sep 30 22:22:35 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:36 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b" returned: 0 in 0.466s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:36 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b Sep 30 22:22:36 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:36 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2a482bca-436f-479a-9bdb-0089e9d26d1b" returned: 0 in 0.297s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Lock "cinder-quobyte-2a482bca-436f-479a-9bdb-0089e9d26d1b" released by "delete_volume" :: held 0.946s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['5fc5b37a-bb10-4fa3-84b7-1773de55a55e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:36 devstack cinder-volume[87240]: WARNING cinder.quota [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-945448391 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-945448391, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Created reservations ['34c4d046-7ab5-456a-ad33-7162593b34a6', 'f5a70315-c2c4-46ef-bcec-067958c2a46e', '7817d871-f838-47a1-8e98-7db6f0b44518', 'bd3fec69-565c-4db8-8f98-f52b471f0623'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:36 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:22:36 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:36 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.351s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:36 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:22:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-267a3eb3-16cd-44ad-a366-99862b7dec37 tempest-GroupSnapshotsTest-1018021155 None] Delete group completed successfully. Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Flow 'volume_create_manager' (94b8ab8e-4971-4c30-8453-d8dd9454b6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24643a48-e09a-460b-bfc1-ee227df227a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24643a48-e09a-460b-bfc1-ee227df227a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-558361031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d40866-5d6d-49ab-9113-48cbadc0e402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275281d718e5468295f66183fc7a72ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:40Z,use_quota=True,user_id='febe047090b04860992bba07cfd3054c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a76588-8810-4ba5-9451-d15270bfb6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a76588-8810-4ba5-9451-d15270bfb6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ed716c-7190-4294-a7e3-031be32f089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ed716c-7190-4294-a7e3-031be32f089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d40866-5d6d-49ab-9113-48cbadc0e402', 'volume_name': 'volume-40d40866-5d6d-49ab-9113-48cbadc0e402', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255e9182-4c96-41e8-9818-b4cdfd5302ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255e9182-4c96-41e8-9818-b4cdfd5302ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453705aa-fc3c-4e40-840a-4b337aecfbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Volume 40d40866-5d6d-49ab-9113-48cbadc0e402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d40866-5d6d-49ab-9113-48cbadc0e402', 'volume_size': 1} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-558361031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d40866-5d6d-49ab-9113-48cbadc0e402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275281d718e5468295f66183fc7a72ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:40Z,use_quota=True,user_id='febe047090b04860992bba07cfd3054c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Creating volume 40d40866-5d6d-49ab-9113-48cbadc0e402 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:22:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:40 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402 1073741824 Sep 30 22:22:40 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:40 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402 1073741824" returned: 0 in 0.473s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:40 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402 Sep 30 22:22:40 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:41 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:22:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453705aa-fc3c-4e40-840a-4b337aecfbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d40866-5d6d-49ab-9113-48cbadc0e402', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a0b892-55ab-4c6b-97af-79c0b9b5c5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Volume volume-40d40866-5d6d-49ab-9113-48cbadc0e402 (40d40866-5d6d-49ab-9113-48cbadc0e402): created successfully Sep 30 22:22:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a0b892-55ab-4c6b-97af-79c0b9b5c5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Flow 'volume_create_manager' (94b8ab8e-4971-4c30-8453-d8dd9454b6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-45cf2bcd-720a-4976-a794-c0111cd8b685 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Created volume successfully. Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-68a15f73-56a0-4488-8048-33ef4804bfe1 req-db83cc53-b983-47b8-a60c-22848314843e tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-68a15f73-56a0-4488-8048-33ef4804bfe1 req-db83cc53-b983-47b8-a60c-22848314843e tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-68a15f73-56a0-4488-8048-33ef4804bfe1 req-db83cc53-b983-47b8-a60c-22848314843e tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-68a15f73-56a0-4488-8048-33ef4804bfe1 req-db83cc53-b983-47b8-a60c-22848314843e tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-40d40866-5d6d-49ab-9113-48cbadc0e402', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1be53add-7930-4895-bfa0-f699b268b056', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Flow 'volume_create_manager' (6f80a7d4-da35-433d-9815-a66c92ca567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc901e07-52af-4887-9c16-2f367e4d7249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc901e07-52af-4887-9c16-2f367e4d7249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1458925625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301390b7-9d21-42d0-b8c5-812a4d3b2e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace68979e7d24fbeb8ef5f7c30466e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:44Z,use_quota=True,user_id='1f251618688d4be3a58bc66e699b8efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1246e1c6-0b0f-4abc-b69a-60c1b3a747ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1246e1c6-0b0f-4abc-b69a-60c1b3a747ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993257c2-fa53-4681-8d42-604ca765674a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993257c2-fa53-4681-8d42-604ca765674a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301390b7-9d21-42d0-b8c5-812a4d3b2e3f', 'volume_name': 'volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377d40ac-c183-4b0c-a11a-4be01ee15680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377d40ac-c183-4b0c-a11a-4be01ee15680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717bad58-8bbb-4921-a9f3-9b4286043d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:43 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f', 'volume_size': 1} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1458925625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301390b7-9d21-42d0-b8c5-812a4d3b2e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace68979e7d24fbeb8ef5f7c30466e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:22:44Z,use_quota=True,user_id='1f251618688d4be3a58bc66e699b8efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Creating volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:22:43 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:22:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-68a15f73-56a0-4488-8048-33ef4804bfe1 req-db83cc53-b983-47b8-a60c-22848314843e tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] attachment_update completed successfully. Sep 30 22:22:43 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f 1073741824 Sep 30 22:22:43 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:44 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f 1073741824" returned: 0 in 0.507s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:44 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f Sep 30 22:22:44 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:44 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" returned: 0 in 0.307s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:22:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717bad58-8bbb-4921-a9f3-9b4286043d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dc0248-32d2-4d74-91bd-7e2c0422a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:22:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Volume volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f (301390b7-9d21-42d0-b8c5-812a4d3b2e3f): created successfully Sep 30 22:22:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dc0248-32d2-4d74-91bd-7e2c0422a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:22:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Flow 'volume_create_manager' (6f80a7d4-da35-433d-9815-a66c92ca567f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:22:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3deb3ba3-cd2e-4ae8-84e5-62a4fef69285 tempest-SnapshotsActionsTest-1950482003 None] Created volume successfully. Sep 30 22:22:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Creating offline snapshot 1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:22:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf03386f-9ece-4f4a-96c7-0ea2e15fd3ea]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:46 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f Sep 30 22:22:46 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:46 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" returned: 0 in 0.414s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:46 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 1G Sep 30 22:22:46 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:47 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 1G" returned: 0 in 0.465s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:47 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:22:47 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-92a087ca-1a6f-4757-b3aa-fbfc12a463aa req-e9ca6945-69e9-4161-99cc-6f6efb910033 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Terminate volume connection completed successfully. Sep 30 22:22:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-92a087ca-1a6f-4757-b3aa-fbfc12a463aa req-e9ca6945-69e9-4161-99cc-6f6efb910033 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Deleting attachment 1be53add-7930-4895-bfa0-f699b268b056. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:22:47 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.382s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:47 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 is being set with open permissions: ugo+rw Sep 30 22:22:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:47 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:22:47 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:47 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:47 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.info Sep 30 22:22:47 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:47 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.info" returned: 0 in 0.282s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:47 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.info is being set with open permissions: ugo+rw Sep 30 22:22:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:47 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.info Sep 30 22:22:47 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Acquiring lock "cinder-40d40866-5d6d-49ab-9113-48cbadc0e402-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "cinder-40d40866-5d6d-49ab-9113-48cbadc0e402-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Acquiring lock "cinder-quobyte-40d40866-5d6d-49ab-9113-48cbadc0e402" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "cinder-quobyte-40d40866-5d6d-49ab-9113-48cbadc0e402" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:48 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.info" returned: 0 in 0.416s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f14eaf8-a2e4-47d8-a888-fe7aefa98c95]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c518b309-836c-4c57-b011-662ba3ccee35 tempest-SnapshotsActionsTest-1950482003 None] Create snapshot completed successfully Sep 30 22:22:48 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402 Sep 30 22:22:48 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:48 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:48 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402 Sep 30 22:22:48 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:49 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40d40866-5d6d-49ab-9113-48cbadc0e402" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "cinder-quobyte-40d40866-5d6d-49ab-9113-48cbadc0e402" released by "delete_volume" :: held 0.682s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Created reservations ['037c9ef6-5b14-4866-a1b0-88291553375f', '27a9a873-45e5-4669-9720-8dc6208628b0', 'a3766815-ec19-4f9e-b363-d246d0c9bef3', '322ae6a4-2b1a-4b0c-9794-2be8e6abc88c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:49 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:22:49 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:49 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.269s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:22:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Deleted volume successfully. Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b764d78f-b0ed-4e05-8e10-4080242728e2 tempest-TestServerVolumeAttachScenarioOldVersion-1972620434 None] Lock "cinder-40d40866-5d6d-49ab-9113-48cbadc0e402-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Creating offline snapshot dbc98583-906c-4a7d-9776-bef87d87f465 of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:22:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc2d17-64a7-42a0-b4db-413a25285509]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:50 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:22:50 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:50 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.543s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:50 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 1G Sep 30 22:22:50 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:51 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 1G" returned: 0 in 0.510s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:51 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 Sep 30 22:22:51 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:51 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465" returned: 0 in 0.306s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:51 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 is being set with open permissions: ugo+rw Sep 30 22:22:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:51 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 Sep 30 22:22:51 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:51 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465" returned: 0 in 0.294s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.777s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5c8b846a-cf6a-40bc-9a16-322baebf39bd tempest-SnapshotsActionsTest-1950482003 None] Create snapshot completed successfully Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-dbc98583-906c-4a7d-9776-bef87d87f465-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-dbc98583-906c-4a7d-9776-bef87d87f465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-quobyte-dbc98583-906c-4a7d-9776-bef87d87f465" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-dbc98583-906c-4a7d-9776-bef87d87f465" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Deleting offline snapshot dbc98583-906c-4a7d-9776-bef87d87f465 of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] snapshot_file for this snap is: volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fe60ca-8854-4f27-8758-a0259cff037d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:52 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 Sep 30 22:22:52 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:52 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465" returned: 0 in 0.414s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[677ecd47-e6b2-4ee9-858a-d1cdc061ec7a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:52 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:22:52 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:53 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.390s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:53 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 Sep 30 22:22:53 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:53 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465" returned: 0 in 0.399s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:53 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465 Sep 30 22:22:53 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:53 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.dbc98583-906c-4a7d-9776-bef87d87f465" returned: 0 in 0.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-dbc98583-906c-4a7d-9776-bef87d87f465" released by "_delete_snapshot" :: held 1.657s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" released by "delete_snapshot" :: held 1.684s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:53 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Created reservations ['a61f2088-4cb0-4679-a8ff-3d41ce457cf4', '002543f2-1b54-4bca-bfe5-f64b290b3828', 'd4cda7b5-5864-4ce8-a231-51298d2bd672', '9200fe6d-0c1e-4a34-8cbb-8b60167b5db0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Delete snapshot completed successfully. Sep 30 22:22:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d9f48b85-beb7-45c3-8050-74fc0f30bb3f tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-dbc98583-906c-4a7d-9776-bef87d87f465-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Creating offline snapshot e8258b8f-11aa-465b-8511-043bdf69e14a of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:22:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b7182-1612-4fb2-b68e-8e0e3abc9de6]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:54 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:22:54 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:55 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.427s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:55 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a 1G Sep 30 22:22:55 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:55 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a 1G" returned: 0 in 0.526s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:55 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a Sep 30 22:22:55 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:56 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a" returned: 0 in 0.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:56 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a is being set with open permissions: ugo+rw Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:56 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a Sep 30 22:22:56 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:56 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.628s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:22:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d30bcc99-6770-4f8a-8395-ee06175b7bc1 tempest-SnapshotsActionsTest-1950482003 None] Create snapshot completed successfully Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-e8258b8f-11aa-465b-8511-043bdf69e14a-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-e8258b8f-11aa-465b-8511-043bdf69e14a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-quobyte-e8258b8f-11aa-465b-8511-043bdf69e14a" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-e8258b8f-11aa-465b-8511-043bdf69e14a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:22:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Deleting offline snapshot e8258b8f-11aa-465b-8511-043bdf69e14a of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] snapshot_file for this snap is: volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc1913-f2b6-4458-b660-98816b90a1ef]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:57 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a Sep 30 22:22:57 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:57 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a" returned: 0 in 0.391s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4e8c74-cc0b-46cc-af58-b4be6e512455]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:57 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:22:57 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:57 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.363s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:57 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a Sep 30 22:22:57 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:58 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a" returned: 0 in 0.454s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:58 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a Sep 30 22:22:58 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:58 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.e8258b8f-11aa-465b-8511-043bdf69e14a" returned: 0 in 0.276s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-e8258b8f-11aa-465b-8511-043bdf69e14a" released by "_delete_snapshot" :: held 1.610s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" released by "delete_snapshot" :: held 1.636s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:58 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Created reservations ['e3e516e4-7141-4936-bfca-11cad6f17955', 'b89f2ff7-cc5f-453a-929d-c2e1431de48f', '77ca5040-488a-4485-ae8d-f17c4875f7bd', 'e2ba6028-879b-406f-aea0-3baa0f23774d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:22:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Delete snapshot completed successfully. Sep 30 22:22:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-10779b61-52dc-4657-8395-b9faf4201e35 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-e8258b8f-11aa-465b-8511-043bdf69e14a-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:22:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:22:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Creating offline snapshot 24320846-f07d-4e1f-93c7-9bb0642a74b1 of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:22:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9994f75-b8b9-4b22-b8eb-ae7a4bf17ebc]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:22:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:22:59 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:22:59 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:22:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-e00d74f3-a9f5-46ba-9586-9732ccbd5010 req-b0c6ce6e-b981-4510-9755-0db0e3e927f4 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:22:59 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 30 22:22:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.365s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:22:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:22:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:00 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 1G Sep 30 22:23:00 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:00 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 1G" returned: 0 in 0.517s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:00 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 Sep 30 22:23:00 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:00 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1" returned: 0 in 0.332s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:00 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 is being set with open permissions: ugo+rw Sep 30 22:23:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:00 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 Sep 30 22:23:00 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:01 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.620s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-e00d74f3-a9f5-46ba-9586-9732ccbd5010 req-b0c6ce6e-b981-4510-9755-0db0e3e927f4 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.327s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-e00d74f3-a9f5-46ba-9586-9732ccbd5010 req-b0c6ce6e-b981-4510-9755-0db0e3e927f4 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-969be1bd-85ed-4764-b21d-50979e794be8 tempest-SnapshotsActionsTest-1950482003 None] Create snapshot completed successfully Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-e00d74f3-a9f5-46ba-9586-9732ccbd5010 req-b0c6ce6e-b981-4510-9755-0db0e3e927f4 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-f1e9a19d-6336-41bd-b814-c6c110fe625b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8658f6c5-422d-4315-a513-042a44ea3b95', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:23:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-e00d74f3-a9f5-46ba-9586-9732ccbd5010 req-b0c6ce6e-b981-4510-9755-0db0e3e927f4 tempest-TestServerVolumeAttachmentScenario-1453095735 None] attachment_update completed successfully. Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-24320846-f07d-4e1f-93c7-9bb0642a74b1-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-24320846-f07d-4e1f-93c7-9bb0642a74b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-quobyte-24320846-f07d-4e1f-93c7-9bb0642a74b1" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-24320846-f07d-4e1f-93c7-9bb0642a74b1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Deleting offline snapshot 24320846-f07d-4e1f-93c7-9bb0642a74b1 of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] snapshot_file for this snap is: volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d006190e-67c3-45d3-96e1-4ab74c954767]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:02 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 Sep 30 22:23:02 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:02 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1" returned: 0 in 0.455s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:23:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3f99d5-9e8e-4845-a3ec-f5eb47bb78ca]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:02 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:23:02 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:02 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.438s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:23:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:02 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 Sep 30 22:23:02 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:03 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:23:03 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:03 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1" returned: 0 in 0.447s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:03 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1 Sep 30 22:23:03 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:03 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.367s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:23:03 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.24320846-f07d-4e1f-93c7-9bb0642a74b1" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-24320846-f07d-4e1f-93c7-9bb0642a74b1" released by "_delete_snapshot" :: held 1.829s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" released by "delete_snapshot" :: held 1.857s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Created reservations ['e23e2283-74a6-4c52-9216-230f742cbf91', '80ea07b6-3d6f-4863-b3d7-08d4315cbf1d', 'd39d20b1-2125-4052-9de2-cdb5449865ad', '7478700a-6cc8-4872-9fd9-a722e7e538f5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:23:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Delete snapshot completed successfully. Sep 30 22:23:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad246579-6859-4a94-9e2b-525236aeafca tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-24320846-f07d-4e1f-93c7-9bb0642a74b1-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Creating offline snapshot 6eea81cd-30d9-4667-9a9b-89b70186cc75 of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:23:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[65169097-8a0d-49a2-94ed-3e5a677eaf6f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:04 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:23:04 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:04 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.458s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:23:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:05 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 1G Sep 30 22:23:05 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:05 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 1G" returned: 0 in 0.571s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:05 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 Sep 30 22:23:05 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:05 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75" returned: 0 in 0.333s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:05 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 is being set with open permissions: ugo+rw Sep 30 22:23:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:05 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 Sep 30 22:23:05 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:06 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75" returned: 0 in 0.273s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.775s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-69b50605-062f-43aa-8577-45d4eefaa42f tempest-SnapshotsActionsTest-1950482003 None] Create snapshot completed successfully Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-6eea81cd-30d9-4667-9a9b-89b70186cc75-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-6eea81cd-30d9-4667-9a9b-89b70186cc75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Acquiring lock "cinder-quobyte-6eea81cd-30d9-4667-9a9b-89b70186cc75" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-6eea81cd-30d9-4667-9a9b-89b70186cc75" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Deleting offline snapshot 6eea81cd-30d9-4667-9a9b-89b70186cc75 of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] snapshot_file for this snap is: volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07182f6-660e-45f9-acab-03a89f4c02a1]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:07 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 Sep 30 22:23:07 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7144f1f4-3d0f-459d-aeb6-3504a3cccc7c req-44ad58fc-2567-49e3-b4c7-c6027a1c37fd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7144f1f4-3d0f-459d-aeb6-3504a3cccc7c req-44ad58fc-2567-49e3-b4c7-c6027a1c37fd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7144f1f4-3d0f-459d-aeb6-3504a3cccc7c req-44ad58fc-2567-49e3-b4c7-c6027a1c37fd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7144f1f4-3d0f-459d-aeb6-3504a3cccc7c req-44ad58fc-2567-49e3-b4c7-c6027a1c37fd tempest-TestServerVolumeAttachmentScenario-1453095735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-b13b4817-efa1-402c-b872-0793b4aeed91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '223e9bb5-1984-46c1-ba83-7d21531b2025', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:23:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-7144f1f4-3d0f-459d-aeb6-3504a3cccc7c req-44ad58fc-2567-49e3-b4c7-c6027a1c37fd tempest-TestServerVolumeAttachmentScenario-1453095735 None] attachment_update completed successfully. Sep 30 22:23:07 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75" returned: 0 in 0.513s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b7728d-3d6c-4688-8725-7a8d89fa9353]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:07 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:23:07 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:07 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.474s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:23:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:07 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 Sep 30 22:23:07 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:08 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75" returned: 0 in 0.451s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:08 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75 Sep 30 22:23:08 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:08 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.6eea81cd-30d9-4667-9a9b-89b70186cc75" returned: 0 in 0.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-6eea81cd-30d9-4667-9a9b-89b70186cc75" released by "_delete_snapshot" :: held 1.832s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" released by "delete_snapshot" :: held 1.854s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:08 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Created reservations ['30e9f2a0-4b2c-4d41-8295-ec896193b0ba', '02aa8031-ee8d-40d6-9b54-d57bdee13788', 'c581cfc2-ae2c-46e5-b953-1072757ae42c', 'f02ccb78-b8f1-475c-a761-5fe7cacc5cea'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:23:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Delete snapshot completed successfully. Sep 30 22:23:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af9ff890-1908-4546-b4c6-901f8975e8d2 tempest-SnapshotsActionsTest-1152573934 None] Lock "cinder-6eea81cd-30d9-4667-9a9b-89b70186cc75-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "cinder-1f64ed6c-e5b6-4890-b248-7d341d4ad3e6-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-1f64ed6c-e5b6-4890-b248-7d341d4ad3e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "cinder-quobyte-1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-quobyte-1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Deleting offline snapshot 1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 of volume 301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] snapshot_file for this snap is: volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c26a8c-de48-49c5-9e74-ab91c33bca4e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:09 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:23:09 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:09 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.395s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[14373390-99b9-4232-91e8-3cd9d0a5e637]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-96a13229-72a6-40d5-bddb-9b439c97d1d5 req-ac46008e-d8af-4ae8-8070-f2b86daa7e02 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Terminate volume connection completed successfully. Sep 30 22:23:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-96a13229-72a6-40d5-bddb-9b439c97d1d5 req-ac46008e-d8af-4ae8-8070-f2b86daa7e02 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Deleting attachment 223e9bb5-1984-46c1-ba83-7d21531b2025. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:23:10 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f Sep 30 22:23:10 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:10 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" returned: 0 in 0.417s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:10 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:23:10 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:10 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.488s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:10 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6 Sep 30 22:23:10 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:11 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f.1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" returned: 0 in 0.342s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-quobyte-1f64ed6c-e5b6-4890-b248-7d341d4ad3e6" released by "_delete_snapshot" :: held 1.828s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" released by "delete_snapshot" :: held 1.862s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Created reservations ['1cdd78bd-8438-437d-b679-eb038cbf63fd', '5db117d3-ba41-4a00-9a0a-9afbc048e283', '1f261974-94b9-452e-aa64-168a60af2330', 'fd5d9c2d-3957-4304-8699-ef846d50ee1a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:23:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Delete snapshot completed successfully. Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f90d288-2861-4208-8b2c-45b1a2edd177 tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-1f64ed6c-e5b6-4890-b248-7d341d4ad3e6-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "cinder-301390b7-9d21-42d0-b8c5-812a4d3b2e3f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-301390b7-9d21-42d0-b8c5-812a4d3b2e3f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a02cb-061e-40f5-9b65-6efdb5e3a9f4]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-dfabc8e7-0665-49ec-a2dd-f0c80cae00b7 req-29c19bcd-59ea-4136-9bf8-6951cc9a799f tempest-TestServerVolumeAttachmentScenario-1453095735 None] Terminate volume connection completed successfully. Sep 30 22:23:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-dfabc8e7-0665-49ec-a2dd-f0c80cae00b7 req-29c19bcd-59ea-4136-9bf8-6951cc9a799f tempest-TestServerVolumeAttachmentScenario-1453095735 None] Deleting attachment 8658f6c5-422d-4315-a513-042a44ea3b95. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:23:11 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f Sep 30 22:23:11 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:12 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" returned: 0 in 0.427s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:12 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f Sep 30 22:23:12 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:12 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" returned: 0 in 0.329s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-quobyte-301390b7-9d21-42d0-b8c5-812a4d3b2e3f" released by "delete_volume" :: held 0.852s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Created reservations ['1fa56003-22eb-4e1a-a4d3-b6e4290c01b8', '7317e2a5-d75c-4613-bf71-0b6b8000d0ce', 'd090fb2b-4b5f-4338-bb9b-3937b013a263', '4612fa5d-90aa-4291-bf88-2273f104b1d7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:12 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:23:12 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:13 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.378s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:13 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:23:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Deleted volume successfully. Sep 30 22:23:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-02a3025a-3153-42da-880e-7a5ca954545b tempest-SnapshotsActionsTest-1950482003 None] Lock "cinder-301390b7-9d21-42d0-b8c5-812a4d3b2e3f-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "cinder-b13b4817-efa1-402c-b872-0793b4aeed91-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "cinder-b13b4817-efa1-402c-b872-0793b4aeed91-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "cinder-quobyte-b13b4817-efa1-402c-b872-0793b4aeed91" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "cinder-quobyte-b13b4817-efa1-402c-b872-0793b4aeed91" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a6206-76ac-41d9-ad71-a7c8f50f2b2c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:20 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91 Sep 30 22:23:20 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:20 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91" returned: 0 in 0.425s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:20 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91 Sep 30 22:23:20 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:21 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b13b4817-efa1-402c-b872-0793b4aeed91" returned: 0 in 0.274s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "cinder-quobyte-b13b4817-efa1-402c-b872-0793b4aeed91" released by "delete_volume" :: held 0.752s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Created reservations ['b4191cc2-f774-4412-97b0-091be99db522', '58746902-61d3-454d-ad64-e39eea5940ed', '9d924095-e9db-4216-a598-58edc631761c', '0bb3bd96-6dd4-4bd1-9e52-7bc425e5ebc0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:21 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:23:21 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "cinder-f1e9a19d-6336-41bd-b814-c6c110fe625b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "cinder-f1e9a19d-6336-41bd-b814-c6c110fe625b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "cinder-quobyte-f1e9a19d-6336-41bd-b814-c6c110fe625b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "cinder-quobyte-f1e9a19d-6336-41bd-b814-c6c110fe625b" acquired by "delete_volume" :: waited 0.049s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c8e396-11ae-40ea-836e-6eae40ed46f2]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:21 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.372s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:23:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Deleted volume successfully. Sep 30 22:23:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80c0d413-5980-4cec-a459-7c573b173eb7 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "cinder-b13b4817-efa1-402c-b872-0793b4aeed91-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:21 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b Sep 30 22:23:21 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:22 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b" returned: 0 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:22 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b Sep 30 22:23:22 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:22 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f1e9a19d-6336-41bd-b814-c6c110fe625b" returned: 0 in 0.306s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "cinder-quobyte-f1e9a19d-6336-41bd-b814-c6c110fe625b" released by "delete_volume" :: held 0.753s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Created reservations ['a4408013-8819-49c7-8972-3fa0cb23c8c5', 'fe77438b-1411-4acb-be84-2d5239b4c829', 'b492b52a-ef34-4d5d-a3c5-8016cbb56267', 'c40de946-5ac3-4b3b-8f91-3f0c959b50a5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:22 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:23:22 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:22 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.317s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:23:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Deleted volume successfully. Sep 30 22:23:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7fb87c2a-fddf-4d40-bc0d-25c0da275a26 tempest-TestServerVolumeAttachmentScenario-1453095735 None] Lock "cinder-f1e9a19d-6336-41bd-b814-c6c110fe625b-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Flow 'volume_create_manager' (9bd89e69-0beb-4302-8783-e85b2705b84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0026ed4a-ebf6-488e-a552-0dc4026be66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0026ed4a-ebf6-488e-a552-0dc4026be66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1404801582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9ab4bd-427d-4901-8732-5bb607828acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='139ff60662424b6fbffe1f8d0bec177a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:23:23Z,use_quota=True,user_id='ee81ba49a20e4ccbac32f7e071772a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de967892-7be5-447a-bf14-4bfcf629282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de967892-7be5-447a-bf14-4bfcf629282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22db1e23-ad2b-49de-865c-0abdc845e01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22db1e23-ad2b-49de-865c-0abdc845e01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9ab4bd-427d-4901-8732-5bb607828acc', 'volume_name': 'volume-7f9ab4bd-427d-4901-8732-5bb607828acc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cce76f3-a2b9-4537-bf2f-57df3d9c212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cce76f3-a2b9-4537-bf2f-57df3d9c212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04c73d2-9bd4-4bef-9642-25f0f3cc7c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:23 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Volume 7f9ab4bd-427d-4901-8732-5bb607828acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9ab4bd-427d-4901-8732-5bb607828acc', 'volume_size': 1} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1404801582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9ab4bd-427d-4901-8732-5bb607828acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='139ff60662424b6fbffe1f8d0bec177a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:23:23Z,use_quota=True,user_id='ee81ba49a20e4ccbac32f7e071772a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Creating volume 7f9ab4bd-427d-4901-8732-5bb607828acc {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:23:23 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:23 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc 1073741824 Sep 30 22:23:23 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:23 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc 1073741824" returned: 0 in 0.532s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:23 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc Sep 30 22:23:23 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:24 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc" returned: 0 in 0.278s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:23:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04c73d2-9bd4-4bef-9642-25f0f3cc7c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9ab4bd-427d-4901-8732-5bb607828acc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b507042-3784-4a70-9d41-84845799de70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:24 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Volume volume-7f9ab4bd-427d-4901-8732-5bb607828acc (7f9ab4bd-427d-4901-8732-5bb607828acc): created successfully Sep 30 22:23:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b507042-3784-4a70-9d41-84845799de70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Flow 'volume_create_manager' (9bd89e69-0beb-4302-8783-e85b2705b84f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:23:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5f3b7fe0-b5bc-4eb5-9d42-70b0b9025038 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Created volume successfully. Sep 30 22:23:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Acquiring lock "cinder-7f9ab4bd-427d-4901-8732-5bb607828acc-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "cinder-7f9ab4bd-427d-4901-8732-5bb607828acc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Acquiring lock "cinder-quobyte-7f9ab4bd-427d-4901-8732-5bb607828acc" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "cinder-quobyte-7f9ab4bd-427d-4901-8732-5bb607828acc" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5bba6e-b8c2-46a7-b0be-3f1023938b3a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:26 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc Sep 30 22:23:26 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:27 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc" returned: 0 in 0.437s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:27 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc Sep 30 22:23:27 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:27 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-7f9ab4bd-427d-4901-8732-5bb607828acc" returned: 0 in 0.289s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "cinder-quobyte-7f9ab4bd-427d-4901-8732-5bb607828acc" released by "delete_volume" :: held 0.786s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=114,cinder:INSERT=24,cinder:UPDATE=92,cinder:DELETE=8 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=114,cinder:SELECT=108,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Created reservations ['5a885988-f8ca-4abd-932b-1bd8972530ea', 'e382b3f4-ed3d-4462-b41e-1388e89436c7', 'a9334986-2eb9-486a-9295-fc4082e0d08a', '260cc91d-68bd-4637-945d-08bbe0163c09'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:27 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:23:27 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:27 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.297s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:23:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Deleted volume successfully. Sep 30 22:23:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-84886ef9-a5c3-4997-84f3-c16f574d1899 tempest-VolumeQuotasNegativeTestJSON-1312064257 None] Lock "cinder-7f9ab4bd-427d-4901-8732-5bb607828acc-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-e950ac55-548f-4726-971a-3649e21c1f53 req-cf7d5074-5a55-4e7c-a5f0-29fe69016691 tempest-ServerActionsTestOtherA-17232984 None] Terminate volume connection completed successfully. Sep 30 22:23:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-e950ac55-548f-4726-971a-3649e21c1f53 req-cf7d5074-5a55-4e7c-a5f0-29fe69016691 tempest-ServerActionsTestOtherA-17232984 None] Deleting attachment 03b4bf69-def6-4812-9228-027068149a5d. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:23:34 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:23:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Flow 'volume_create_manager' (7d7e99e9-dd08-45a3-ab24-486cd2cf7a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:23:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69942872-9405-4154-b40d-fedabaa9d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69942872-9405-4154-b40d-fedabaa9d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-706014435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a638e186b4bf1844bc2a03d1e92ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:23:35Z,use_quota=True,user_id='b2527eef3b364bf69432cc56252235e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f21cc-ce69-4d8e-a175-65de5d63af56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63f21cc-ce69-4d8e-a175-65de5d63af56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec93b0c-8c92-4f2e-9990-98816bbdf0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:34 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:23:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec93b0c-8c92-4f2e-9990-98816bbdf0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef', 'volume_name': 'volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e66ec17-9ea0-4106-a79e-cd93b203eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e66ec17-9ea0-4106-a79e-cd93b203eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a75dadf-8637-4aba-a667-f458a114d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Volume e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 22:23:35 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Trying to clone e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:23:36 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Image download 20.69 MB at 20.69 MB/s Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a7341-e2c3-4c6e-8cf1-5c6f89163601]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:36 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD Sep 30 22:23:36 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Flow 'volume_create_manager' (ff209b03-180d-4315-9425-ac997b9eee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba3eba8-7e59-4eed-8cfa-0b6461e5e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba3eba8-7e59-4eed-8cfa-0b6461e5e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-469269865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b597557c-d0c4-4043-b74f-dd67109b305a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8771fde74d5a4242a8819efbbcdb94d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:23:36Z,use_quota=True,user_id='213c4e8ca7a4408ebd02256788138e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0194a4a5-e8b3-4ecb-b7e2-a1faed6bf4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0194a4a5-e8b3-4ecb-b7e2-a1faed6bf4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e41204-50dd-49ca-a68a-ee5873bd60fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:23:36 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a is fetched for user b2527eef3b364bf69432cc56252235e6. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3adb02-7b36-47da-ada1-19831c08af5f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:36 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD Sep 30 22:23:36 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e41204-50dd-49ca-a68a-ee5873bd60fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b597557c-d0c4-4043-b74f-dd67109b305a', 'volume_name': 'volume-b597557c-d0c4-4043-b74f-dd67109b305a', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e5bbb2-0464-4b0d-955d-abc9bb9dff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e5bbb2-0464-4b0d-955d-abc9bb9dff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1172afc-61b3-42ec-9292-630685203c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:37 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Volume b597557c-d0c4-4043-b74f-dd67109b305a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b597557c-d0c4-4043-b74f-dd67109b305a', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Trying to clone b597557c-d0c4-4043-b74f-dd67109b305a from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:23:37 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-706014435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001a638e186b4bf1844bc2a03d1e92ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:23:35Z,use_quota=True,user_id='b2527eef3b364bf69432cc56252235e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Creating volume e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:23:37 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:37 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef 1073741824 Sep 30 22:23:37 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:23:37 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Image download 20.69 MB at 20.69 MB/s Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4b7cea-c7d8-403f-8b5c-7e9e436e5f2c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:37 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD Sep 30 22:23:37 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:37 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef 1073741824" returned: 0 in 0.669s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:38 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef Sep 30 22:23:38 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Flow 'volume_create_manager' (81279151-4f57-488d-b076-1837befafdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f80c670-8675-4429-b23f-9e15907e5386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f80c670-8675-4429-b23f-9e15907e5386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-44768773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb893c98-d876-4209-bbf0-8bd570a54bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f893116e7e4601a8cb6b1c6fe55f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:23:38Z,use_quota=True,user_id='afdafcef845e4bd89f489e64018aa0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08071fe7-6653-42f3-bff9-9e0a4f5a9205),volume_type_id=08071fe7-6653-42f3-bff9-9e0a4f5a9205)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69925f97-1aa9-416e-935c-d11d365e15c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69925f97-1aa9-416e-935c-d11d365e15c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ee3b86-446f-4d26-9bc0-d2237575c7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ee3b86-446f-4d26-9bc0-d2237575c7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb893c98-d876-4209-bbf0-8bd570a54bb9', 'volume_name': 'volume-bb893c98-d876-4209-bbf0-8bd570a54bb9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad38c51-8daa-4ff7-9491-53b28bb53456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad38c51-8daa-4ff7-9491-53b28bb53456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1d72b1-dc8c-4059-ada9-b5153b698bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Volume bb893c98-d876-4209-bbf0-8bd570a54bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb893c98-d876-4209-bbf0-8bd570a54bb9', 'volume_size': 1} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:38 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a is fetched for user 213c4e8ca7a4408ebd02256788138e70. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d568e5c-0c9e-48e3-b4b2-066e90d84549]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:38 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef" returned: 0 in 0.311s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-44768773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb893c98-d876-4209-bbf0-8bd570a54bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f893116e7e4601a8cb6b1c6fe55f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:23:38Z,use_quota=True,user_id='afdafcef845e4bd89f489e64018aa0e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08071fe7-6653-42f3-bff9-9e0a4f5a9205),volume_type_id=08071fe7-6653-42f3-bff9-9e0a4f5a9205)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Creating volume bb893c98-d876-4209-bbf0-8bd570a54bb9 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:23:38 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:38 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 1073741824 Sep 30 22:23:38 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Attempting download of 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:23:38 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD Sep 30 22:23:38 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c149d-c550-4aca-8540-5e199a36319b]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_xfncd43n {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:38 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_xfncd43n Sep 30 22:23:38 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:38 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:38 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 1073741824" returned: 0 in 0.540s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:38 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_xfncd43n" returned: 0 in 0.414s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_xfncd43n {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:38 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 Sep 30 22:23:38 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:39 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_xfncd43n Sep 30 22:23:39 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:39 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9" returned: 0 in 0.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.473s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-469269865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b597557c-d0c4-4043-b74f-dd67109b305a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8771fde74d5a4242a8819efbbcdb94d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:23:36Z,use_quota=True,user_id='213c4e8ca7a4408ebd02256788138e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Creating volume b597557c-d0c4-4043-b74f-dd67109b305a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:23:39 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1d72b1-dc8c-4059-ada9-b5153b698bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb893c98-d876-4209-bbf0-8bd570a54bb9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:39 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f244bc4-a483-4057-b2cb-c37f71ab8e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:39 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a 1073741824 Sep 30 22:23:39 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_xfncd43n" returned: 1 in 0.368s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_xfncd43n' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d42fca-b87e-47fd-bd2e-d974944a86e7]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Volume volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 (bb893c98-d876-4209-bbf0-8bd570a54bb9): created successfully Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f244bc4-a483-4057-b2cb-c37f71ab8e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Flow 'volume_create_manager' (81279151-4f57-488d-b076-1837befafdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:23:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c010d18f-8183-4994-92e2-55fc92404409 tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Created volume successfully. Sep 30 22:23:39 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD Sep 30 22:23:39 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:39 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a was qcow2, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:39 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef Sep 30 22:23:39 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:39 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a 1073741824" returned: 0 in 0.521s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:39 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a Sep 30 22:23:39 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:40 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a" returned: 0 in 0.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Attempting download of 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume b597557c-d0c4-4043-b74f-dd67109b305a. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[de451249-a792-42a1-b730-b415c931bb49]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_5qz6wkkx {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:40 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_5qz6wkkx Sep 30 22:23:40 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:40 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_5qz6wkkx" returned: 0 in 0.567s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_5qz6wkkx {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4cc49a22-eb2a-42bc-8a44-2908cb80cd7d tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4cc49a22-eb2a-42bc-8a44-2908cb80cd7d tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4cc49a22-eb2a-42bc-8a44-2908cb80cd7d tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4cc49a22-eb2a-42bc-8a44-2908cb80cd7d tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4cc49a22-eb2a-42bc-8a44-2908cb80cd7d tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4cc49a22-eb2a-42bc-8a44-2908cb80cd7d tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:40 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_5qz6wkkx Sep 30 22:23:40 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:40 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:23:40 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:41 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_5qz6wkkx" returned: 1 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_5qz6wkkx' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:23:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf83929-9b0a-4a52-a293-128fdf4d6319]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:41 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4cc49a22-eb2a-42bc-8a44-2908cb80cd7d tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.300s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:41 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4cc49a22-eb2a-42bc-8a44-2908cb80cd7d tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:23:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4cc49a22-eb2a-42bc-8a44-2908cb80cd7d tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Retype volume completed successfully. Sep 30 22:23:41 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD Sep 30 22:23:41 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:41 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:41 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a was qcow2, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:23:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:41 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a Sep 30 22:23:41 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:42 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef" returned: 0 in 2.428s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_p22pgcuodevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:23:42 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Converted 112.00 MB image at 46.08 MB/s Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:42 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef 1G Sep 30 22:23:42 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Acquiring lock "cinder-bb893c98-d876-4209-bbf0-8bd570a54bb9-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "cinder-bb893c98-d876-4209-bbf0-8bd570a54bb9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:42 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef 1G" returned: 0 in 0.435s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Downloaded image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a for user b2527eef3b364bf69432cc56252235e6 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Marking volume e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Copying metadata from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a to e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Creating volume glance metadata for volume e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef backed by image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Acquiring lock "cinder-quobyte-bb893c98-d876-4209-bbf0-8bd570a54bb9" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "cinder-quobyte-bb893c98-d876-4209-bbf0-8bd570a54bb9" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e0eb8b-bfd0-455f-8660-4dcf46f76454]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a75dadf-8637-4aba-a667-f458a114d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399a891b-9858-4d79-a9db-fd4654d47a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Volume volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef (e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef): created successfully Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399a891b-9858-4d79-a9db-fd4654d47a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Flow 'volume_create_manager' (7d7e99e9-dd08-45a3-ab24-486cd2cf7a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:23:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bbb910d6-fe60-46f8-9415-9be952832124 tempest-ServerActionsTestOtherA-17232984 None] Created volume successfully. Sep 30 22:23:42 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 Sep 30 22:23:42 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:43 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9" returned: 0 in 0.447s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:43 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9 Sep 30 22:23:43 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:43 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bb893c98-d876-4209-bbf0-8bd570a54bb9" returned: 0 in 0.325s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "cinder-quobyte-bb893c98-d876-4209-bbf0-8bd570a54bb9" released by "delete_volume" :: held 0.835s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:43 devstack cinder-volume[87240]: WARNING cinder.quota [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:23:43 devstack cinder-volume[87240]: WARNING cinder.quota [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Created reservations ['7459b6a0-1810-466b-8d79-8718fb7783f9', '3c676714-8a17-4079-9be6-100d193d79d6', '8a6a5a56-885e-4df1-a745-f607fdeaf838', '5c11d549-ca8f-4e69-b724-5b25665c7791'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:43 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:23:43 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:44 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.471s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:23:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Deleted volume successfully. Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fc8c003-bba7-4fca-94b4-0126575e9bde tempest-VolumeRetypeWithoutMigrationTest-1531253339 None] Lock "cinder-bb893c98-d876-4209-bbf0-8bd570a54bb9-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:23:44 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a" returned: 0 in 2.540s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_tbw3d3ajdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:23:44 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Converted 112.00 MB image at 44.08 MB/s Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:23:44 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a 1G Sep 30 22:23:44 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:23:44 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a 1G" returned: 0 in 0.502s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Downloaded image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume b597557c-d0c4-4043-b74f-dd67109b305a successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a for user 213c4e8ca7a4408ebd02256788138e70 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Marking volume b597557c-d0c4-4043-b74f-dd67109b305a as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Copying metadata from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a to b597557c-d0c4-4043-b74f-dd67109b305a. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Creating volume glance metadata for volume b597557c-d0c4-4043-b74f-dd67109b305a backed by image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1172afc-61b3-42ec-9292-630685203c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b597557c-d0c4-4043-b74f-dd67109b305a', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53aa7ca0-dc69-4457-89ea-6d503ec43532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:23:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Volume volume-b597557c-d0c4-4043-b74f-dd67109b305a (b597557c-d0c4-4043-b74f-dd67109b305a): created successfully Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53aa7ca0-dc69-4457-89ea-6d503ec43532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:23:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Flow 'volume_create_manager' (ff209b03-180d-4315-9425-ac997b9eee1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:23:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6c9683be-0e66-4929-9e83-09a2f63ce26b tempest-TestShelveInstance-179394962 None] Created volume successfully. Sep 30 22:23:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-1710ebdd-b00c-4e8b-975c-8e87fe988f97 req-a466959a-cb31-4a0b-934c-909f03f09d40 tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-1710ebdd-b00c-4e8b-975c-8e87fe988f97 req-a466959a-cb31-4a0b-934c-909f03f09d40 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-1710ebdd-b00c-4e8b-975c-8e87fe988f97 req-a466959a-cb31-4a0b-934c-909f03f09d40 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-1710ebdd-b00c-4e8b-975c-8e87fe988f97 req-a466959a-cb31-4a0b-934c-909f03f09d40 tempest-ServerActionsTestOtherA-17232984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c0d6d9e-6f41-4e74-9d1f-7bae46e73dd0', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:23:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-1710ebdd-b00c-4e8b-975c-8e87fe988f97 req-a466959a-cb31-4a0b-934c-909f03f09d40 tempest-ServerActionsTestOtherA-17232984 None] attachment_update completed successfully. Sep 30 22:23:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-c6eb63a1-c25c-47ae-84d0-81bfbbb85689 req-3c313971-ec3c-4ad0-860b-18910a9050f3 tempest-TestShelveInstance-179394962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:23:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-c6eb63a1-c25c-47ae-84d0-81bfbbb85689 req-3c313971-ec3c-4ad0-860b-18910a9050f3 tempest-TestShelveInstance-179394962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:23:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-c6eb63a1-c25c-47ae-84d0-81bfbbb85689 req-3c313971-ec3c-4ad0-860b-18910a9050f3 tempest-TestShelveInstance-179394962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:23:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-c6eb63a1-c25c-47ae-84d0-81bfbbb85689 req-3c313971-ec3c-4ad0-860b-18910a9050f3 tempest-TestShelveInstance-179394962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-b597557c-d0c4-4043-b74f-dd67109b305a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe1cf7bc-2b07-4657-9758-8648873aeab2', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:23:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-c6eb63a1-c25c-47ae-84d0-81bfbbb85689 req-3c313971-ec3c-4ad0-860b-18910a9050f3 tempest-TestShelveInstance-179394962 None] attachment_update completed successfully. Sep 30 22:24:02 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=40,cinder:DELETE=4,cinder:SELECT=34,cinder:INSERT=17 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:24:02 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=66,cinder:INSERT=20,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:03 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:24:03 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:03 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.486s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:24:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Flow 'volume_create_manager' (80b5e14d-2594-4cfb-b4f1-3e96d29a828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162c1c21-2f69-4f27-86f4-9aba3375ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162c1c21-2f69-4f27-86f4-9aba3375ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1783022879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cec0811-6289-4ae5-9ab8-ac0b9ab83162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9536dd6baad247229a16ba612a872118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:24:08Z,use_quota=True,user_id='4a56fd82687049c1bee8ac77df41b1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cf16a8-8187-4ef4-9ff8-cedab38d6734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cf16a8-8187-4ef4-9ff8-cedab38d6734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd1bc8b-7512-4ce8-8f32-a182c161c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd1bc8b-7512-4ce8-8f32-a182c161c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cec0811-6289-4ae5-9ab8-ac0b9ab83162', 'volume_name': 'volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22a389d-18e5-4328-922b-2bc9c6909c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22a389d-18e5-4328-922b-2bc9c6909c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493585f7-e387-4a99-8cc5-78173f443abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Volume 9cec0811-6289-4ae5-9ab8-ac0b9ab83162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162', 'volume_size': 1} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1783022879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cec0811-6289-4ae5-9ab8-ac0b9ab83162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9536dd6baad247229a16ba612a872118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:24:08Z,use_quota=True,user_id='4a56fd82687049c1bee8ac77df41b1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Creating volume 9cec0811-6289-4ae5-9ab8-ac0b9ab83162 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:24:08 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:24:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:08 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 1073741824 Sep 30 22:24:08 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:09 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 1073741824" returned: 0 in 1.104s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:09 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 Sep 30 22:24:09 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:10 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" returned: 0 in 0.461s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:24:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493585f7-e387-4a99-8cc5-78173f443abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48e02b2-88b2-462b-a4bf-d7d2014e813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Volume volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 (9cec0811-6289-4ae5-9ab8-ac0b9ab83162): created successfully Sep 30 22:24:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48e02b2-88b2-462b-a4bf-d7d2014e813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Flow 'volume_create_manager' (80b5e14d-2594-4cfb-b4f1-3e96d29a828f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:24:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5f4ea6ab-a5e2-4e79-94de-8751734091b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Created volume successfully. Sep 30 22:24:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Creating offline snapshot b0176ffb-697d-4c94-aa0d-0d931fbaaefa of volume 9cec0811-6289-4ae5-9ab8-ac0b9ab83162 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:24:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef05c77e-951a-46fd-b694-e7a2e12f1bd4]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:24:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Flow 'volume_create_manager' (b80bad64-3d37-4616-a8c2-39e3897f4696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24be5092-316e-4fb1-a8af-fd9682ec8076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24be5092-316e-4fb1-a8af-fd9682ec8076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1617320408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae16b2a-8990-4262-a2ce-c459d63f901b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fbbe2f643c4993b7985f65829e95b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:24:12Z,use_quota=True,user_id='6a07c9cc37d9463a9a4e2bb5fcfd52eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a52904-0460-4a95-abd2-58f21a804bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a52904-0460-4a95-abd2-58f21a804bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec2be4a-6aa2-435c-ad3f-afb417953460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec2be4a-6aa2-435c-ad3f-afb417953460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae16b2a-8990-4262-a2ce-c459d63f901b', 'volume_name': 'volume-3ae16b2a-8990-4262-a2ce-c459d63f901b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:12 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 Sep 30 22:24:12 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a4169b-a763-4816-adc5-76a1052edf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a4169b-a763-4816-adc5-76a1052edf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae934ff1-3aee-4cc6-a952-3b5aeab8cda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Volume 3ae16b2a-8990-4262-a2ce-c459d63f901b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae16b2a-8990-4262-a2ce-c459d63f901b', 'volume_size': 1} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:12 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" returned: 0 in 1.155s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:13 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa 1G Sep 30 22:24:13 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:13 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa 1G" returned: 0 in 0.889s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:13 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa Sep 30 22:24:13 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:14 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa" returned: 0 in 0.850s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:14 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa is being set with open permissions: ugo+rw Sep 30 22:24:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:14 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa Sep 30 22:24:14 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:15 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa" returned: 0 in 0.928s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:15 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.info Sep 30 22:24:15 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:16 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.info" returned: 0 in 0.766s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:16 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.info is being set with open permissions: ugo+rw Sep 30 22:24:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:16 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.info Sep 30 22:24:16 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:17 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.info" returned: 0 in 0.746s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.654s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.996s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1617320408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae16b2a-8990-4262-a2ce-c459d63f901b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fbbe2f643c4993b7985f65829e95b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:24:12Z,use_quota=True,user_id='6a07c9cc37d9463a9a4e2bb5fcfd52eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Creating volume 3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:24:17 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:24:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c3a1844f-7b22-422b-86ba-93170558b9e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Create snapshot completed successfully Sep 30 22:24:17 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b 1073741824 Sep 30 22:24:17 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:18 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b 1073741824" returned: 0 in 0.768s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:18 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b Sep 30 22:24:18 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:18 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b" returned: 0 in 0.497s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:24:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae934ff1-3aee-4cc6-a952-3b5aeab8cda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae16b2a-8990-4262-a2ce-c459d63f901b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e5fe41-5b75-4887-a5d3-f08e6a098ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Volume volume-3ae16b2a-8990-4262-a2ce-c459d63f901b (3ae16b2a-8990-4262-a2ce-c459d63f901b): created successfully Sep 30 22:24:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e5fe41-5b75-4887-a5d3-f08e6a098ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Flow 'volume_create_manager' (b80bad64-3d37-4616-a8c2-39e3897f4696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:24:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-99c06f97-1823-4489-b908-5cf9d1bdb950 tempest-TestStampPattern-1401913109 None] Created volume successfully. Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Acquiring lock "cinder-b0176ffb-697d-4c94-aa0d-0d931fbaaefa-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-b0176ffb-697d-4c94-aa0d-0d931fbaaefa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Acquiring lock "cinder-quobyte-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-quobyte-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Acquiring lock "cinder-quobyte-b0176ffb-697d-4c94-aa0d-0d931fbaaefa" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-quobyte-b0176ffb-697d-4c94-aa0d-0d931fbaaefa" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Deleting offline snapshot b0176ffb-697d-4c94-aa0d-0d931fbaaefa of volume 9cec0811-6289-4ae5-9ab8-ac0b9ab83162 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] snapshot_file for this snap is: volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b93b6af-cbc9-4bc1-8eb8-0b4490553676]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:24:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:20 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa Sep 30 22:24:20 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:20 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa" returned: 0 in 1.055s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:24:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[50499b77-4d1d-4157-94ec-e7cf3cb8f5ae]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:24:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:21 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 Sep 30 22:24:21 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:21 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" returned: 0 in 0.885s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:22 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa Sep 30 22:24:22 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-5165f4e3-777b-4a30-930b-8b96a8c97d0f req-d112276f-1238-4f88-b0dd-e1bed620497d tempest-ServerActionsTestOtherA-17232984 None] Terminate volume connection completed successfully. Sep 30 22:24:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-5165f4e3-777b-4a30-930b-8b96a8c97d0f req-d112276f-1238-4f88-b0dd-e1bed620497d tempest-ServerActionsTestOtherA-17232984 None] Deleting attachment 2c0d6d9e-6f41-4e74-9d1f-7bae46e73dd0. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:24:22 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa" returned: 0 in 0.902s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:22 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa Sep 30 22:24:22 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:23 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162.b0176ffb-697d-4c94-aa0d-0d931fbaaefa" returned: 0 in 0.318s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-quobyte-b0176ffb-697d-4c94-aa0d-0d931fbaaefa" released by "_delete_snapshot" :: held 3.529s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:24:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-quobyte-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" released by "delete_snapshot" :: held 3.592s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:24:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Created reservations ['9fc5d259-f24d-453e-ba7a-c7d95d319bb9', '9d0a6556-ee8a-4331-bfc7-57864d0d54c1', '7ede8ec2-748d-4496-9caa-5b8d7d24e2b2', '75598d42-b105-4f81-94f7-9381ac1b9643'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:24:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Delete snapshot completed successfully. Sep 30 22:24:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-146ac95f-a13e-4cfc-9d90-ceb7f8b5813a tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-b0176ffb-697d-4c94-aa0d-0d931fbaaefa-delete_snapshot" released by "delete_snapshot" :: held 3.824s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:24:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Acquiring lock "cinder-9cec0811-6289-4ae5-9ab8-ac0b9ab83162-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:24:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-9cec0811-6289-4ae5-9ab8-ac0b9ab83162-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:24:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Acquiring lock "cinder-quobyte-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:24:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-quobyte-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:24:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fda4fa-2f58-4897-9e6c-df22293f4dd9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:24:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:24 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 Sep 30 22:24:24 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:25 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" returned: 0 in 0.563s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:25 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162 Sep 30 22:24:25 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-5165f4e3-777b-4a30-930b-8b96a8c97d0f req-d7f8bc5f-984f-439a-b4f5-26b38a886d67 tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-5165f4e3-777b-4a30-930b-8b96a8c97d0f req-d7f8bc5f-984f-439a-b4f5-26b38a886d67 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-5165f4e3-777b-4a30-930b-8b96a8c97d0f req-d7f8bc5f-984f-439a-b4f5-26b38a886d67 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-5165f4e3-777b-4a30-930b-8b96a8c97d0f req-d7f8bc5f-984f-439a-b4f5-26b38a886d67 tempest-ServerActionsTestOtherA-17232984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2887627b-939e-4a96-b555-b570519f6a1f', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:24:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-5165f4e3-777b-4a30-930b-8b96a8c97d0f req-d7f8bc5f-984f-439a-b4f5-26b38a886d67 tempest-ServerActionsTestOtherA-17232984 None] attachment_update completed successfully. Sep 30 22:24:25 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" returned: 0 in 0.381s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-quobyte-9cec0811-6289-4ae5-9ab8-ac0b9ab83162" released by "delete_volume" :: held 1.078s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Created reservations ['e23a8eea-4d6a-469f-b217-88cf8b80c2ed', '9fff59b3-79fa-4003-90f3-c756dbe4df91', '2c8c7055-2dff-4cc8-8e5a-e9717f667915', 'bbe2a418-7017-44c7-a2bf-7f120e377a5b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:25 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:24:25 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:26 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.576s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:26 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:24:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Deleted volume successfully. Sep 30 22:24:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-521cad8c-9434-4ab2-936f-40227bf44f40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1663210353 None] Lock "cinder-9cec0811-6289-4ae5-9ab8-ac0b9ab83162-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:24:35 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=21,cinder:SELECT=22,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:24:36 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=30,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:24:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-0c23985e-3c8b-4faf-8794-4268c8965f39 req-c9181b3f-26cb-4c9a-8dad-ac005abc37f7 tempest-TestShelveInstance-179394962 None] Terminate volume connection completed successfully. Sep 30 22:24:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-0c23985e-3c8b-4faf-8794-4268c8965f39 req-c9181b3f-26cb-4c9a-8dad-ac005abc37f7 tempest-TestShelveInstance-179394962 None] Deleting attachment fe1cf7bc-2b07-4657-9758-8648873aeab2. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-aea47095-c592-45e0-965a-4cf377caf9b7 req-16d03953-e694-407b-8f25-a29359baf687 tempest-TestShelveInstance-179394962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-aea47095-c592-45e0-965a-4cf377caf9b7 req-16d03953-e694-407b-8f25-a29359baf687 tempest-TestShelveInstance-179394962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-aea47095-c592-45e0-965a-4cf377caf9b7 req-16d03953-e694-407b-8f25-a29359baf687 tempest-TestShelveInstance-179394962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Flow 'volume_create_manager' (7015c941-4c64-4b07-841a-cbaaa62fc331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630d746f-2c44-4215-8a5a-a8cc6e907458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630d746f-2c44-4215-8a5a-a8cc6e907458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1995467293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163a03a8-aba6-4d16-95df-e6f1adeba567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbe35d50514a21b699c271e66582e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:24:49Z,use_quota=True,user_id='602971edd1d844108dc6e5e3d3ccd3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105defc0-c704-431c-91f0-1d9992284bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105defc0-c704-431c-91f0-1d9992284bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7068408-483d-4c83-9211-5de25e992fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7068408-483d-4c83-9211-5de25e992fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163a03a8-aba6-4d16-95df-e6f1adeba567', 'volume_name': 'volume-163a03a8-aba6-4d16-95df-e6f1adeba567', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ae528b-3508-4e2e-bc90-a85c91a047c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ae528b-3508-4e2e-bc90-a85c91a047c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe367e7-a10e-471e-add9-a8c9afdfe3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Volume 163a03a8-aba6-4d16-95df-e6f1adeba567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163a03a8-aba6-4d16-95df-e6f1adeba567', 'volume_size': 1} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1995467293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163a03a8-aba6-4d16-95df-e6f1adeba567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbe35d50514a21b699c271e66582e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:24:49Z,use_quota=True,user_id='602971edd1d844108dc6e5e3d3ccd3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Creating volume 163a03a8-aba6-4d16-95df-e6f1adeba567 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:24:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-aea47095-c592-45e0-965a-4cf377caf9b7 req-16d03953-e694-407b-8f25-a29359baf687 tempest-TestShelveInstance-179394962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-b597557c-d0c4-4043-b74f-dd67109b305a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9c13e1e-91db-492a-9ef4-4aaf058c3f1c', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:24:49 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567 1073741824 Sep 30 22:24:49 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-aea47095-c592-45e0-965a-4cf377caf9b7 req-16d03953-e694-407b-8f25-a29359baf687 tempest-TestShelveInstance-179394962 None] attachment_update completed successfully. Sep 30 22:24:50 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567 1073741824" returned: 0 in 0.622s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:50 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567 Sep 30 22:24:50 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:50 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567" returned: 0 in 0.293s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:24:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe367e7-a10e-471e-add9-a8c9afdfe3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163a03a8-aba6-4d16-95df-e6f1adeba567', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd123526-5ad7-403e-a9bc-63500a5b6e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:24:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Volume volume-163a03a8-aba6-4d16-95df-e6f1adeba567 (163a03a8-aba6-4d16-95df-e6f1adeba567): created successfully Sep 30 22:24:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd123526-5ad7-403e-a9bc-63500a5b6e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:24:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Flow 'volume_create_manager' (7015c941-4c64-4b07-841a-cbaaa62fc331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:24:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5948baa1-115f-4b43-b6d1-a8ecba1e22cb tempest-VolumesMetadataTest-2096713638 None] Created volume successfully. Sep 30 22:24:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Acquiring lock "cinder-163a03a8-aba6-4d16-95df-e6f1adeba567-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:24:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Lock "cinder-163a03a8-aba6-4d16-95df-e6f1adeba567-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:24:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Acquiring lock "cinder-quobyte-163a03a8-aba6-4d16-95df-e6f1adeba567" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:24:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Lock "cinder-quobyte-163a03a8-aba6-4d16-95df-e6f1adeba567" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:24:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15a1443-1c13-44a1-9d6e-bff87aee865e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:24:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:52 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567 Sep 30 22:24:52 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:53 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567" returned: 0 in 0.856s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:53 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567 Sep 30 22:24:53 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:53 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-163a03a8-aba6-4d16-95df-e6f1adeba567" returned: 0 in 0.370s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Lock "cinder-quobyte-163a03a8-aba6-4d16-95df-e6f1adeba567" released by "delete_volume" :: held 1.283s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Created reservations ['eb820004-0de4-45d7-bb16-011ad7409087', 'a54f97fc-ba73-4cd3-831b-f873d353080b', 'd50163fb-6f98-4435-b630-9d7c7c998bca', '661e9f3a-f541-4cbb-b1d6-605680d3e035'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:24:53 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:24:53 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:24:54 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 30 22:24:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:24:54 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:24:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Deleted volume successfully. Sep 30 22:24:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0641685-4b7f-40be-b641-ce6690188ca7 tempest-VolumesMetadataTest-2096713638 None] Lock "cinder-163a03a8-aba6-4d16-95df-e6f1adeba567-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:24:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-82c96a74-3222-494b-adef-d4ab192fa5d2 req-3e6aff44-c289-4d5a-bc67-cf703d4d56ec tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:24:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-82c96a74-3222-494b-adef-d4ab192fa5d2 req-3e6aff44-c289-4d5a-bc67-cf703d4d56ec tempest-TestStampPattern-1401913109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:24:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-82c96a74-3222-494b-adef-d4ab192fa5d2 req-3e6aff44-c289-4d5a-bc67-cf703d4d56ec tempest-TestStampPattern-1401913109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:24:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-82c96a74-3222-494b-adef-d4ab192fa5d2 req-3e6aff44-c289-4d5a-bc67-cf703d4d56ec tempest-TestStampPattern-1401913109 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-3ae16b2a-8990-4262-a2ce-c459d63f901b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a1f266b-f7e9-492f-af48-037db751a6ab', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:24:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-82c96a74-3222-494b-adef-d4ab192fa5d2 req-3e6aff44-c289-4d5a-bc67-cf703d4d56ec tempest-TestStampPattern-1401913109 None] attachment_update completed successfully. Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Flow 'volume_create_manager' (9fdaf3e5-cebf-4cb4-b760-3543f0178457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b3eecc-678f-41a4-8854-f2189e1d96da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b3eecc-678f-41a4-8854-f2189e1d96da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1646850797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8573a7-8c35-4c3c-8919-aaa86662c82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7b5a4e9c494dd0921a7a4faa27e9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:25:02Z,use_quota=True,user_id='a9c9f6248a6c4c4e87ff6804a8e5d655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309ebf75-134d-4112-a97e-63c56a9cf211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (309ebf75-134d-4112-a97e-63c56a9cf211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d19244e-2eda-4876-8c59-17138dc15636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d19244e-2eda-4876-8c59-17138dc15636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8573a7-8c35-4c3c-8919-aaa86662c82f', 'volume_name': 'volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ae37f8-938f-4a23-8d8a-008a7d4d4d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ae37f8-938f-4a23-8d8a-008a7d4d4d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2c50b0-10af-4257-958d-115b134fac1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:02 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Volume 8b8573a7-8c35-4c3c-8919-aaa86662c82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f', 'volume_size': 1} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1646850797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8573a7-8c35-4c3c-8919-aaa86662c82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7b5a4e9c494dd0921a7a4faa27e9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:25:02Z,use_quota=True,user_id='a9c9f6248a6c4c4e87ff6804a8e5d655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Creating volume 8b8573a7-8c35-4c3c-8919-aaa86662c82f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:25:02 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:25:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:02 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f 1073741824 Sep 30 22:25:02 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:02 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f 1073741824" returned: 0 in 0.775s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:03 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f Sep 30 22:25:03 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:03 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:25:03 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:03 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f" returned: 0 in 0.491s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2c50b0-10af-4257-958d-115b134fac1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da326ad-1286-4c9c-8be5-e83baf7d1a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Volume volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f (8b8573a7-8c35-4c3c-8919-aaa86662c82f): created successfully Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da326ad-1286-4c9c-8be5-e83baf7d1a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Flow 'volume_create_manager' (9fdaf3e5-cebf-4cb4-b760-3543f0178457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-53e91037-122d-4d98-abcf-0931e018b94d tempest-VolumesTransfersTest-572309618 None] Created volume successfully. Sep 30 22:25:03 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.556s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:25:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-3ff68753-3e1f-4247-ba62-bc31abfe2395 tempest-ServerActionsTestOtherA-17232984 None] Terminate volume connection completed successfully. Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-3ff68753-3e1f-4247-ba62-bc31abfe2395 tempest-ServerActionsTestOtherA-17232984 None] Deleting attachment 2887627b-939e-4a96-b555-b570519f6a1f. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "cinder-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Lock "cinder-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "cinder-quobyte-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Lock "cinder-quobyte-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cd4ea9-fa15-406c-8338-ce842470ff94]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:04 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef Sep 30 22:25:04 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:04 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef" returned: 0 in 0.582s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:04 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef Sep 30 22:25:04 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:05 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef" returned: 0 in 0.401s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Lock "cinder-quobyte-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef" released by "delete_volume" :: held 1.051s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.quota [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Created reservations ['2d12022f-a722-417f-bfb8-f009b4f7f2b2', '94f36ab9-617e-4906-85ea-6e6962b517d5', 'd6166326-5e90-4730-b26f-5c257096092d', '7d0169df-d165-4fb1-b66c-e4ad6a084bdc'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:05 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:25:05 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c36f8d42-0de7-437d-be63-2b0a8f1ad625 tempest-VolumesTransfersTest-1552358028 None] Transfer volume completed successfully. Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "cinder-c0577898-f773-4dc5-94e7-2c8ca754d8e0-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Lock "cinder-c0577898-f773-4dc5-94e7-2c8ca754d8e0-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "cinder-quobyte-c0577898-f773-4dc5-94e7-2c8ca754d8e0" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-32165c72-e546-4ee5-a457-8aa338bdb7ca req-adc5e49f-fd48-4785-beb0-6d79ef9238ab tempest-TestStampPattern-1401913109 None] Terminate volume connection completed successfully. Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-32165c72-e546-4ee5-a457-8aa338bdb7ca req-adc5e49f-fd48-4785-beb0-6d79ef9238ab tempest-TestStampPattern-1401913109 None] Deleting attachment 3a1f266b-f7e9-492f-af48-037db751a6ab. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Lock "cinder-quobyte-c0577898-f773-4dc5-94e7-2c8ca754d8e0" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fefd74f-041c-4741-a3f4-31d0bf3464d6]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:05 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.570s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:05 devstack cinder-volume[87240]: DEBUG cinder.manager [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:25:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Deleted volume successfully. Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9f1a6d1c-50b2-4861-8ac2-1211fcb5e19d req-1740ac12-7833-4b83-a553-b24c7f92841e tempest-ServerActionsTestOtherA-17232984 None] Lock "cinder-e50bd6e8-7fe3-4873-ba0f-4bbc3145e4ef-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:06 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 Sep 30 22:25:06 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Acquiring lock "cinder-8b8573a7-8c35-4c3c-8919-aaa86662c82f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Lock "cinder-8b8573a7-8c35-4c3c-8919-aaa86662c82f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:06 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Acquiring lock "cinder-quobyte-8b8573a7-8c35-4c3c-8919-aaa86662c82f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0" returned: 0 in 0.608s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Lock "cinder-quobyte-8b8573a7-8c35-4c3c-8919-aaa86662c82f" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:06 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0 Sep 30 22:25:06 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Creating offline snapshot 53dd95c9-1c8f-46d3-81ef-92c639a4d54e of volume 3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7b3fe0-d3cf-408c-963f-9b59fab01d54]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[defc8aed-9d5f-4df7-92ee-4443db325b6c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:06 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b Sep 30 22:25:06 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:06 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f Sep 30 22:25:06 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:06 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0577898-f773-4dc5-94e7-2c8ca754d8e0" returned: 0 in 0.410s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Lock "cinder-quobyte-c0577898-f773-4dc5-94e7-2c8ca754d8e0" released by "delete_volume" :: held 1.099s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Created reservations ['9f3dd4e2-1336-4bf9-a244-0fc6a42b6224', 'd156b0c9-bdda-46c1-81b6-0b0ef670fe72', '9ad154cc-4867-4039-8363-f6ce159cdf0c', '84bf5349-5edb-4d82-ab2c-5ebad95c4b87'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:25:06 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b" returned: 0 in 0.444s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:07 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e 1G Sep 30 22:25:07 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:07 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f" returned: 0 in 0.520s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:07 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f Sep 30 22:25:07 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:07 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:25:07 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:07 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:07 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b8573a7-8c35-4c3c-8919-aaa86662c82f" returned: 0 in 0.304s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Deleted volume successfully. Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Lock "cinder-quobyte-8b8573a7-8c35-4c3c-8919-aaa86662c82f" released by "delete_volume" :: held 0.892s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa8e1e0d-cd85-4123-968c-fad276b914c6 tempest-ServerActionsTestOtherA-17232984 None] Lock "cinder-c0577898-f773-4dc5-94e7-2c8ca754d8e0-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Created reservations ['fd514cbb-89c5-41a0-88a4-e3004afce038', '06b7a71e-b9aa-4db6-96b8-a5175fc0bbbc', '44f6f553-0a14-40db-8af0-b9307597d747', '6309bda6-728b-41e0-a47b-c373e837a804'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:07 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:07 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:25:07 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e 1G" returned: 0 in 0.604s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae16b2a-8990-4262-a2ce-c459d63f901b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:07 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae16b2a-8990-4262-a2ce-c459d63f901b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e Sep 30 22:25:07 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:07 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.280s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:25:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Deleted volume successfully. Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81b084c8-2632-4aa9-9f7a-bc52c8d8167a tempest-VolumesTransfersTest-645538530 None] Lock "cinder-8b8573a7-8c35-4c3c-8919-aaa86662c82f-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:07 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae16b2a-8990-4262-a2ce-c459d63f901b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e" returned: 0 in 0.345s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:07 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e is being set with open permissions: ugo+rw Sep 30 22:25:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:08 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e Sep 30 22:25:08 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:08 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e" returned: 0 in 0.311s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:08 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.info Sep 30 22:25:08 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:08 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.info" returned: 0 in 0.458s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:08 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.info is being set with open permissions: ugo+rw Sep 30 22:25:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:08 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.info Sep 30 22:25:08 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:09 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.info" returned: 0 in 0.323s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-03efac2f-f9bd-4838-a5be-fad5115149de tempest-TestStampPattern-1401913109 None] Create snapshot completed successfully Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Flow 'volume_create_manager' (548341fa-293a-4f34-b787-006d8a1996ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7067522c-6656-4788-aba1-6740fd1bb070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7067522c-6656-4788-aba1-6740fd1bb070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-369401612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd7fe04-ef63-4708-988b-94e2bb374fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7b5a4e9c494dd0921a7a4faa27e9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:25:10Z,use_quota=True,user_id='a9c9f6248a6c4c4e87ff6804a8e5d655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ecde20-cf1d-4fcd-ba6f-9b938f80e422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ecde20-cf1d-4fcd-ba6f-9b938f80e422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e2853e-63c9-4e1c-959c-08ee07754e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e2853e-63c9-4e1c-959c-08ee07754e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd7fe04-ef63-4708-988b-94e2bb374fd8', 'volume_name': 'volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee8a93e-781d-491b-808b-46269a78680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee8a93e-781d-491b-808b-46269a78680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aaa5c53-8ac6-412a-8172-a7b63735d16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Volume 6dd7fe04-ef63-4708-988b-94e2bb374fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8', 'volume_size': 1} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-369401612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd7fe04-ef63-4708-988b-94e2bb374fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7b5a4e9c494dd0921a7a4faa27e9f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:25:10Z,use_quota=True,user_id='a9c9f6248a6c4c4e87ff6804a8e5d655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Creating volume 6dd7fe04-ef63-4708-988b-94e2bb374fd8 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:25:09 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:25:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:09 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 1073741824 Sep 30 22:25:09 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:10 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 1073741824" returned: 0 in 0.709s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:10 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 Sep 30 22:25:10 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:10 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8" returned: 0 in 0.402s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:25:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aaa5c53-8ac6-412a-8172-a7b63735d16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5faf19c-7a99-488e-806c-1fba06e5a651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Volume volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 (6dd7fe04-ef63-4708-988b-94e2bb374fd8): created successfully Sep 30 22:25:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5faf19c-7a99-488e-806c-1fba06e5a651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Flow 'volume_create_manager' (548341fa-293a-4f34-b787-006d8a1996ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-24bf35ec-cb92-478c-8368-e58f46ae1f9e tempest-VolumesTransfersTest-572309618 None] Created volume successfully. Sep 30 22:25:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Acquiring lock "cinder-6dd7fe04-ef63-4708-988b-94e2bb374fd8-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Lock "cinder-6dd7fe04-ef63-4708-988b-94e2bb374fd8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Acquiring lock "cinder-quobyte-6dd7fe04-ef63-4708-988b-94e2bb374fd8" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Lock "cinder-quobyte-6dd7fe04-ef63-4708-988b-94e2bb374fd8" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8884f36-66c1-4726-ba91-099a4f73a417]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:12 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 Sep 30 22:25:12 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:12 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8" returned: 0 in 0.586s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:12 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8 Sep 30 22:25:12 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:13 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6dd7fe04-ef63-4708-988b-94e2bb374fd8" returned: 0 in 0.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Lock "cinder-quobyte-6dd7fe04-ef63-4708-988b-94e2bb374fd8" released by "delete_volume" :: held 0.994s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Created reservations ['61c49ac1-ef2a-42cc-b9e6-e370ad26952a', '66015dc1-a579-48b3-a92b-2fa92d68bb4c', '895cab4f-5518-4c66-aae3-9cb15f88ad70', '22eea97d-5fa5-4f07-9715-8129e90999d9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:13 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:25:13 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:13 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.279s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:25:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Deleted volume successfully. Sep 30 22:25:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c782a32-bd2e-4908-acbc-3bc2aed10683 tempest-VolumesTransfersTest-645538530 None] Lock "cinder-6dd7fe04-ef63-4708-988b-94e2bb374fd8-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Flow 'volume_create_manager' (00ec17fa-e3ce-43f1-84cb-403745709306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42c102e-91fd-45e3-bbf9-2e1f58963ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42c102e-91fd-45e3-bbf9-2e1f58963ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-32078902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb4a922-d47c-4e16-9409-bbc9c6d6c903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08fbbe2f643c4993b7985f65829e95b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53dd95c9-1c8f-46d3-81ef-92c639a4d54e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:25:18Z,use_quota=True,user_id='6a07c9cc37d9463a9a4e2bb5fcfd52eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6030ebf-ff27-4865-8e04-884678e38b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6030ebf-ff27-4865-8e04-884678e38b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4023732-50ef-428c-8a0f-65e8b91f7d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4023732-50ef-428c-8a0f-65e8b91f7d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'beb4a922-d47c-4e16-9409-bbc9c6d6c903', 'volume_name': 'volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903', 'volume_size': 1, 'snapshot_id': '53dd95c9-1c8f-46d3-81ef-92c639a4d54e'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4baa1c4c-8766-47e4-8e04-339e9922444c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4baa1c4c-8766-47e4-8e04-339e9922444c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a73a4c-ac66-425a-bcaf-52678326248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Volume beb4a922-d47c-4e16-9409-bbc9c6d6c903: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903', 'volume_size': 1, 'snapshot_id': '53dd95c9-1c8f-46d3-81ef-92c639a4d54e'} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Acquiring lock "cinder-quobyte-53dd95c9-1c8f-46d3-81ef-92c639a4d54e-beb4a922-d47c-4e16-9409-bbc9c6d6c903" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-53dd95c9-1c8f-46d3-81ef-92c639a4d54e-beb4a922-d47c-4e16-9409-bbc9c6d6c903" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Creating volume beb4a922-d47c-4e16-9409-bbc9c6d6c903 from snapshot 53dd95c9-1c8f-46d3-81ef-92c639a4d54e {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Acquiring lock "cinder-quobyte-beb4a922-d47c-4e16-9409-bbc9c6d6c903" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-beb4a922-d47c-4e16-9409-bbc9c6d6c903" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] snapshot: 53dd95c9-1c8f-46d3-81ef-92c639a4d54e, volume: beb4a922-d47c-4e16-9409-bbc9c6d6c903, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3ea793-72fe-4888-a86b-6114d2bbc216]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:18 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e Sep 30 22:25:18 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:19 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e" returned: 0 in 0.601s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ae16b2a-8990-4262-a2ce-c459d63f901b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:25:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d928634-01e3-400e-8b9f-497ab9996dec]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:19 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b Sep 30 22:25:19 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:20 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b" returned: 0 in 0.659s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:25:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:25:20 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:25:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:20 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 Sep 30 22:25:20 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Flow 'volume_create_manager' (2c947d2b-d4f1-4b36-8da7-e90843d84420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4e5480-e2a4-4b42-bef1-78958042ccc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4e5480-e2a4-4b42-bef1-78958042ccc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1906485745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6314da2b-b4cf-4ecc-9f24-7c5609627292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36904f56a67146d690db097173a0f1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:25:28Z,use_quota=True,user_id='94745b63693f4db386a5289fa2de03b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad55902-2685-4765-b2f8-5a8f00d232a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad55902-2685-4765-b2f8-5a8f00d232a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f9b3ed-7efc-42e2-b499-420d54a568a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f9b3ed-7efc-42e2-b499-420d54a568a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6314da2b-b4cf-4ecc-9f24-7c5609627292', 'volume_name': 'volume-6314da2b-b4cf-4ecc-9f24-7c5609627292', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cac5f86-35d9-46a3-9202-aea0ee899abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cac5f86-35d9-46a3-9202-aea0ee899abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c99cc6c-ba2e-40fd-ac67-acf0cd3fb7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Volume 6314da2b-b4cf-4ecc-9f24-7c5609627292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6314da2b-b4cf-4ecc-9f24-7c5609627292', 'volume_size': 1} Sep 30 22:25:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:31 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903" returned: 0 in 11.327s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b, size 1024.00 MB, duration 11.33 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:25:31 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Converted 1024.00 MB image at 90.40 MB/s Sep 30 22:25:31 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 is being set with open permissions: ugo+rw Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:31 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 Sep 30 22:25:31 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:31 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903" returned: 0 in 0.295s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-beb4a922-d47c-4e16-9409-bbc9c6d6c903" released by "_copy_volume_from_snapshot" :: held 13.030s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-53dd95c9-1c8f-46d3-81ef-92c639a4d54e-beb4a922-d47c-4e16-9409-bbc9c6d6c903" released by "_create_volume_from_snapshot" :: held 13.124s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.161s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.842s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1906485745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6314da2b-b4cf-4ecc-9f24-7c5609627292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36904f56a67146d690db097173a0f1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:25:28Z,use_quota=True,user_id='94745b63693f4db386a5289fa2de03b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Creating volume 6314da2b-b4cf-4ecc-9f24-7c5609627292 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:25:31 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:31 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 1073741824 Sep 30 22:25:31 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a73a4c-ac66-425a-bcaf-52678326248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903', 'volume_size': 1, 'snapshot_id': '53dd95c9-1c8f-46d3-81ef-92c639a4d54e'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba64776-4d66-46b1-bf13-edebec37927a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Volume volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 (beb4a922-d47c-4e16-9409-bbc9c6d6c903): created successfully Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba64776-4d66-46b1-bf13-edebec37927a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Flow 'volume_create_manager' (00ec17fa-e3ce-43f1-84cb-403745709306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c7a4d948-e1b0-4352-b1e2-c0ef7a63ed0b tempest-TestStampPattern-1401913109 None] Created volume successfully. Sep 30 22:25:32 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 1073741824" returned: 0 in 0.675s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:32 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 Sep 30 22:25:32 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:32 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292" returned: 0 in 0.327s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:25:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c99cc6c-ba2e-40fd-ac67-acf0cd3fb7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6314da2b-b4cf-4ecc-9f24-7c5609627292', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fc3823-2566-47a1-945a-4740f198ac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Volume volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 (6314da2b-b4cf-4ecc-9f24-7c5609627292): created successfully Sep 30 22:25:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fc3823-2566-47a1-945a-4740f198ac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Flow 'volume_create_manager' (2c947d2b-d4f1-4b36-8da7-e90843d84420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d10f3417-bce1-4855-8cdc-ec979cd0ea43 tempest-VolumesTransfersV355Test-856072997 None] Created volume successfully. Sep 30 22:25:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-00a4d90b-5ebd-483a-b1e5-edffa9190704 tempest-VolumesTransfersV355Test-1405672076 None] Transfer volume completed successfully. Sep 30 22:25:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Acquiring lock "cinder-6314da2b-b4cf-4ecc-9f24-7c5609627292-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Lock "cinder-6314da2b-b4cf-4ecc-9f24-7c5609627292-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Acquiring lock "cinder-quobyte-6314da2b-b4cf-4ecc-9f24-7c5609627292" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Lock "cinder-quobyte-6314da2b-b4cf-4ecc-9f24-7c5609627292" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ae549b-6db7-4d09-99ac-e39639ecfaea]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:36 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 Sep 30 22:25:36 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:36 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292" returned: 0 in 0.689s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:36 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292 Sep 30 22:25:36 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:37 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6314da2b-b4cf-4ecc-9f24-7c5609627292" returned: 0 in 0.443s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Lock "cinder-quobyte-6314da2b-b4cf-4ecc-9f24-7c5609627292" released by "delete_volume" :: held 1.206s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Created reservations ['06edc74a-65bd-4903-9b76-71562b7c4e03', '4a499852-11af-4be8-b7a7-1b95807b8c60', '7bc96170-ea77-4494-92bc-977863ab19cf', 'c8507431-ab1d-4ae7-8c8f-21d0e41b4138'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:37 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:25:37 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-811614eb-0c48-47ef-a3ff-8565a84b1b7f tempest-TestShelveInstance-179394962 None] Terminate volume connection completed successfully. Sep 30 22:25:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-811614eb-0c48-47ef-a3ff-8565a84b1b7f tempest-TestShelveInstance-179394962 None] Deleting attachment a9c13e1e-91db-492a-9ef4-4aaf058c3f1c. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:25:38 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.599s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:38 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:25:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Deleted volume successfully. Sep 30 22:25:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81e266c7-ce33-4331-bb4c-24259204ba70 tempest-VolumesTransfersV355Test-1357323362 None] Lock "cinder-6314da2b-b4cf-4ecc-9f24-7c5609627292-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Acquiring lock "cinder-b597557c-d0c4-4043-b74f-dd67109b305a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Lock "cinder-b597557c-d0c4-4043-b74f-dd67109b305a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Acquiring lock "cinder-quobyte-b597557c-d0c4-4043-b74f-dd67109b305a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Lock "cinder-quobyte-b597557c-d0c4-4043-b74f-dd67109b305a" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0c5ce8-b982-4af4-87cb-14ad8684d62d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:38 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a Sep 30 22:25:38 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:39 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a" returned: 0 in 0.761s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:39 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a Sep 30 22:25:39 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:39 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b597557c-d0c4-4043-b74f-dd67109b305a" returned: 0 in 0.463s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Lock "cinder-quobyte-b597557c-d0c4-4043-b74f-dd67109b305a" released by "delete_volume" :: held 1.336s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Flow 'volume_create_manager' (fc00ddcc-f525-4cd3-97aa-fb9261722274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba26cb17-c77a-46c1-8755-1ee0658dc9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba26cb17-c77a-46c1-8755-1ee0658dc9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-791325836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df173caa-0046-4ffa-9412-02484e44b4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36904f56a67146d690db097173a0f1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:25:40Z,use_quota=True,user_id='94745b63693f4db386a5289fa2de03b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3674cd1-5b8d-4357-b01f-7e046f3e0602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3674cd1-5b8d-4357-b01f-7e046f3e0602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ab8e37-1866-4169-93b7-ede879420c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ab8e37-1866-4169-93b7-ede879420c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df173caa-0046-4ffa-9412-02484e44b4bc', 'volume_name': 'volume-df173caa-0046-4ffa-9412-02484e44b4bc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5218bf3f-64de-49fe-90d8-bc34315a4dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5218bf3f-64de-49fe-90d8-bc34315a4dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454a1691-d30f-430f-9980-c0cf8fd83224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Volume df173caa-0046-4ffa-9412-02484e44b4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df173caa-0046-4ffa-9412-02484e44b4bc', 'volume_size': 1} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-791325836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df173caa-0046-4ffa-9412-02484e44b4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36904f56a67146d690db097173a0f1b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:25:40Z,use_quota=True,user_id='94745b63693f4db386a5289fa2de03b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Creating volume df173caa-0046-4ffa-9412-02484e44b4bc {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:25:39 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.quota [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Created reservations ['dd6ccc57-b690-4ddb-a356-27bec5e70c18', '5f499083-9e7b-4fd6-958c-ad676a0f1d71', '9c28833a-7241-4402-8d69-e2575235509b', '36184c13-aa5a-48e3-9335-2fb8edf479d1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:25:39 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc 1073741824 Sep 30 22:25:39 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:40 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:25:40 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:40 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.549s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:40 devstack cinder-volume[87240]: DEBUG cinder.manager [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:25:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Deleted volume successfully. Sep 30 22:25:40 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-2a56d6bd-6fa3-46dd-99b6-3b3c5cf4719a req-bdac6861-fce8-49f1-93f7-2161f6e7dcf8 tempest-TestShelveInstance-179394962 None] Lock "cinder-b597557c-d0c4-4043-b74f-dd67109b305a-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc 1073741824" returned: 0 in 0.793s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:40 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc Sep 30 22:25:40 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:41 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc" returned: 0 in 0.622s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:25:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454a1691-d30f-430f-9980-c0cf8fd83224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df173caa-0046-4ffa-9412-02484e44b4bc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0723550-12bd-4038-b6af-16094cc6dc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:25:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Volume volume-df173caa-0046-4ffa-9412-02484e44b4bc (df173caa-0046-4ffa-9412-02484e44b4bc): created successfully Sep 30 22:25:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0723550-12bd-4038-b6af-16094cc6dc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:25:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Flow 'volume_create_manager' (fc00ddcc-f525-4cd3-97aa-fb9261722274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:25:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-85833039-ffbc-4499-ac76-892c199bbb45 tempest-VolumesTransfersV355Test-856072997 None] Created volume successfully. Sep 30 22:25:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Acquiring lock "cinder-df173caa-0046-4ffa-9412-02484e44b4bc-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Lock "cinder-df173caa-0046-4ffa-9412-02484e44b4bc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Acquiring lock "cinder-quobyte-df173caa-0046-4ffa-9412-02484e44b4bc" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:25:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Lock "cinder-quobyte-df173caa-0046-4ffa-9412-02484e44b4bc" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:25:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf174441-39ec-41f4-b66c-bc5e4baab454]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:25:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:42 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc Sep 30 22:25:42 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:43 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc" returned: 0 in 0.870s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:43 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc Sep 30 22:25:43 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:43 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-df173caa-0046-4ffa-9412-02484e44b4bc" returned: 0 in 0.517s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Lock "cinder-quobyte-df173caa-0046-4ffa-9412-02484e44b4bc" released by "delete_volume" :: held 1.482s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Created reservations ['fcc44e0d-d518-41c9-93fa-f573e04e15be', '3bea7b9a-bd67-49d3-a87a-d299f14dab85', '6414371b-888f-4bd3-a5a3-3e2431ee2c05', '3e5a0383-3b88-43d1-a0b4-f1625143ed1a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:25:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:25:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:25:44 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:25:44 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:25:44 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 30 22:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.525s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:25:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:25:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Deleted volume successfully. Sep 30 22:25:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9699c0bd-f4de-4e75-8727-ab22510c081d tempest-VolumesTransfersV355Test-1357323362 None] Lock "cinder-df173caa-0046-4ffa-9412-02484e44b4bc-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:25:54 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=68,cinder:UPDATE=84,cinder:DELETE=11,cinder:INSERT=23 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:25:54 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=82,cinder:UPDATE=89,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:26:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-56448a7e-6692-4ed1-bade-5c860e9b7a1e req-cba1a3b6-133d-4173-bf44-a024544119e5 tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-56448a7e-6692-4ed1-bade-5c860e9b7a1e req-cba1a3b6-133d-4173-bf44-a024544119e5 tempest-TestStampPattern-1401913109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-56448a7e-6692-4ed1-bade-5c860e9b7a1e req-cba1a3b6-133d-4173-bf44-a024544119e5 tempest-TestStampPattern-1401913109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-56448a7e-6692-4ed1-bade-5c860e9b7a1e req-cba1a3b6-133d-4173-bf44-a024544119e5 tempest-TestStampPattern-1401913109 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6db54c9-369a-470b-b062-ba7a29861b80', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:26:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-56448a7e-6692-4ed1-bade-5c860e9b7a1e req-cba1a3b6-133d-4173-bf44-a024544119e5 tempest-TestStampPattern-1401913109 None] attachment_update completed successfully. Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:03 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:26:03 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:03 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.640s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:26:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (218edfb9-7a27-4830-8329-9a34d5c4828d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c947a4fb-523f-48ab-b732-fcf26f4c7367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c947a4fb-523f-48ab-b732-fcf26f4c7367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066315627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d0f9e8-d8bd-4ace-acff-514cdef50118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:04Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac55e39-3c43-4ef7-924d-389d8f5b3d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac55e39-3c43-4ef7-924d-389d8f5b3d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827137f1-d16f-4e88-8012-0da6df7098e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827137f1-d16f-4e88-8012-0da6df7098e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d0f9e8-d8bd-4ace-acff-514cdef50118', 'volume_name': 'volume-29d0f9e8-d8bd-4ace-acff-514cdef50118', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65091c1-c920-45c8-95cc-451d7e6b5e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65091c1-c920-45c8-95cc-451d7e6b5e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1320dd-2a09-42ad-b8c4-6ac9ac291d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Volume 29d0f9e8-d8bd-4ace-acff-514cdef50118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d0f9e8-d8bd-4ace-acff-514cdef50118', 'volume_size': 1} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066315627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d0f9e8-d8bd-4ace-acff-514cdef50118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:04Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Creating volume 29d0f9e8-d8bd-4ace-acff-514cdef50118 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:04 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:04 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 1073741824 Sep 30 22:26:04 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (59dbd29c-a07a-428f-baf3-17c46316a019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baa6886-dc20-467c-97df-d610e971c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baa6886-dc20-467c-97df-d610e971c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2053726256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308a2934-1d60-4cb2-81bd-92b33977d8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:05Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924e9a00-4546-48ee-9bdf-ab0f12af188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924e9a00-4546-48ee-9bdf-ab0f12af188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52807b22-73d3-4f4c-8227-95d4e2cc0221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52807b22-73d3-4f4c-8227-95d4e2cc0221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308a2934-1d60-4cb2-81bd-92b33977d8c2', 'volume_name': 'volume-308a2934-1d60-4cb2-81bd-92b33977d8c2', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10f0a97-3645-44a5-96c4-409ecadce2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10f0a97-3645-44a5-96c4-409ecadce2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c66742-c8df-46f8-a73f-3ceadc6d0c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Volume 308a2934-1d60-4cb2-81bd-92b33977d8c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308a2934-1d60-4cb2-81bd-92b33977d8c2', 'volume_size': 1} Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:05 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 1073741824" returned: 0 in 1.064s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:06 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 Sep 30 22:26:06 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (991ebd56-12cc-4a32-87a6-01d159cb306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4d5f6a-a3d6-4c48-88b2-053e2ecbe7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4d5f6a-a3d6-4c48-88b2-053e2ecbe7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1381494247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228fdeed-4159-40bc-8b2c-bfc28df86c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:06Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e154a8-89ce-4b82-8b2b-dde2493d0a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e154a8-89ce-4b82-8b2b-dde2493d0a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e61d64b-db9c-4989-8894-8ae162a4d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e61d64b-db9c-4989-8894-8ae162a4d222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '228fdeed-4159-40bc-8b2c-bfc28df86c50', 'volume_name': 'volume-228fdeed-4159-40bc-8b2c-bfc28df86c50', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31808fe5-8baf-4fd8-b1e9-22e836193ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31808fe5-8baf-4fd8-b1e9-22e836193ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fec11f-3769-43e6-b4d1-205b012db4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Volume 228fdeed-4159-40bc-8b2c-bfc28df86c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-228fdeed-4159-40bc-8b2c-bfc28df86c50', 'volume_size': 1} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:06 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118" returned: 0 in 0.549s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2053726256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308a2934-1d60-4cb2-81bd-92b33977d8c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:05Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Creating volume 308a2934-1d60-4cb2-81bd-92b33977d8c2 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:06 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1320dd-2a09-42ad-b8c4-6ac9ac291d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d0f9e8-d8bd-4ace-acff-514cdef50118', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fa2f5f-bbdc-4f6e-a7fe-bb3a62b668ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:06 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 1073741824 Sep 30 22:26:06 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Volume volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 (29d0f9e8-d8bd-4ace-acff-514cdef50118): created successfully Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83fa2f5f-bbdc-4f6e-a7fe-bb3a62b668ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (218edfb9-7a27-4830-8329-9a34d5c4828d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-41f6074f-04d6-4a91-92f4-b162d5f99f3f tempest-CreateVolumesFromImageTest-1289319 None] Created volume successfully. Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (a7b2d672-b34e-4d49-8436-0b1522301ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811f9a7f-53c3-4da0-a780-c29642f8b65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811f9a7f-53c3-4da0-a780-c29642f8b65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585359334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9e3a5a-f551-4ebf-bd2c-0779274bc473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:07Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31688d6-6b7f-4be0-b9cc-caceb8f47657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31688d6-6b7f-4be0-b9cc-caceb8f47657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500ab378-cc23-4d41-ae2c-0153151d9a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500ab378-cc23-4d41-ae2c-0153151d9a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9e3a5a-f551-4ebf-bd2c-0779274bc473', 'volume_name': 'volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269f0eb0-ba86-46f8-bc17-fd07f6eacf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269f0eb0-ba86-46f8-bc17-fd07f6eacf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7dab41-51ff-48f2-bfdb-be7fb881f5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Volume 9f9e3a5a-f551-4ebf-bd2c-0779274bc473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473', 'volume_size': 1} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:07 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 1073741824" returned: 0 in 1.102s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:07 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 Sep 30 22:26:07 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (d3723332-be6a-4229-9a82-087eab24ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5234a5f2-da11-4c17-9fa9-fce1fa2462da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5234a5f2-da11-4c17-9fa9-fce1fa2462da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355430322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:08Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73aef082-81b8-4de1-a339-5bba39a2f3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73aef082-81b8-4de1-a339-5bba39a2f3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3579f1b-9857-4e9e-b339-b0f6e8ac1ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3579f1b-9857-4e9e-b339-b0f6e8ac1ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97', 'volume_name': 'volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d7d613-989f-49df-9dff-e2fff55aea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d7d613-989f-49df-9dff-e2fff55aea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:08 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b078c-1e0c-43cf-bf46-b4de8fa60831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Volume 3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97', 'volume_size': 1} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2" returned: 0 in 0.791s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.074s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1381494247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228fdeed-4159-40bc-8b2c-bfc28df86c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:06Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Creating volume 228fdeed-4159-40bc-8b2c-bfc28df86c50 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:08 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:08 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 1073741824 Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c66742-c8df-46f8-a73f-3ceadc6d0c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308a2934-1d60-4cb2-81bd-92b33977d8c2', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:08 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b4e568-3f3d-4eb9-a80b-58451580f965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Volume volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 (308a2934-1d60-4cb2-81bd-92b33977d8c2): created successfully Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b4e568-3f3d-4eb9-a80b-58451580f965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (59dbd29c-a07a-428f-baf3-17c46316a019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-361fec6d-3031-496c-9795-2d5398cf332c tempest-CreateVolumesFromImageTest-1289319 None] Created volume successfully. Sep 30 22:26:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-3906e3bc-408b-4def-8567-1b775c9d6b28 req-79c1f958-74f1-4f35-9367-7f0943a38927 tempest-TestStampPattern-1401913109 None] Terminate volume connection completed successfully. Sep 30 22:26:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-3906e3bc-408b-4def-8567-1b775c9d6b28 req-79c1f958-74f1-4f35-9367-7f0943a38927 tempest-TestStampPattern-1401913109 None] Deleting attachment a6db54c9-369a-470b-b062-ba7a29861b80. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:26:09 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 1073741824" returned: 0 in 1.026s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:09 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 Sep 30 22:26:09 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:09 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50" returned: 0 in 0.326s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.718s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585359334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9e3a5a-f551-4ebf-bd2c-0779274bc473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:07Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Creating volume 9f9e3a5a-f551-4ebf-bd2c-0779274bc473 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:10 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fec11f-3769-43e6-b4d1-205b012db4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228fdeed-4159-40bc-8b2c-bfc28df86c50', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:10 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 1073741824 Sep 30 22:26:10 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c2a36a-9abd-47bf-961f-cb66da0c4e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Volume volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 (228fdeed-4159-40bc-8b2c-bfc28df86c50): created successfully Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c2a36a-9abd-47bf-961f-cb66da0c4e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (991ebd56-12cc-4a32-87a6-01d159cb306d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8e030e3f-d07c-4d17-a359-a68861d477c0 tempest-CreateVolumesFromImageTest-1289319 None] Created volume successfully. Sep 30 22:26:10 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 1073741824" returned: 0 in 0.612s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:10 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 Sep 30 22:26:10 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:11 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473" returned: 0 in 0.445s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.627s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355430322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1efd01caf2db4731bcea2f72f69c0eb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:08Z,use_quota=True,user_id='403b8dcbf8324ff7840c793796d0c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Creating volume 3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:11 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7dab41-51ff-48f2-bfdb-be7fb881f5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c657636c-ff1d-42f8-97f5-0d12b4df12f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:11 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 1073741824 Sep 30 22:26:11 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Volume volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 (9f9e3a5a-f551-4ebf-bd2c-0779274bc473): created successfully Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c657636c-ff1d-42f8-97f5-0d12b4df12f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (a7b2d672-b34e-4d49-8436-0b1522301ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-486f8f64-6abb-49aa-8e38-51ac3644501e tempest-CreateVolumesFromImageTest-1289319 None] Created volume successfully. Sep 30 22:26:12 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 1073741824" returned: 0 in 0.980s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:12 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 Sep 30 22:26:12 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:12 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97" returned: 0 in 0.474s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b078c-1e0c-43cf-bf46-b4de8fa60831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab73abd-e50a-4cb6-b3eb-a7241c8726ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Volume volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 (3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97): created successfully Sep 30 22:26:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab73abd-e50a-4cb6-b3eb-a7241c8726ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Flow 'volume_create_manager' (d3723332-be6a-4229-9a82-087eab24ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e98cbfde-771c-4d0d-87ec-fb3dde5e3457 tempest-CreateVolumesFromImageTest-1289319 None] Created volume successfully. Sep 30 22:26:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-quobyte-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b118f1-8e20-4cf0-a0fa-bd0a964eec90]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:13 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 Sep 30 22:26:13 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:14 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97" returned: 0 in 0.886s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:14 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97 Sep 30 22:26:14 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Flow 'volume_create_manager' (64b96ddb-2b7f-4e54-90c1-15ab250367a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0f73ae-e866-4ad1-9dc1-4de145006cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0f73ae-e866-4ad1-9dc1-4de145006cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1128624283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f290ff-c30f-41fe-9ef6-f098663c8e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c3a14d5bcd41478be7b3ad53a3f495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:15Z,use_quota=True,user_id='075425e16ff84334b62a4172711c05e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb510db-1d45-49be-9a9f-4716afd6cf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb510db-1d45-49be-9a9f-4716afd6cf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e43715-8665-450a-8e51-5c669919ef1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e43715-8665-450a-8e51-5c669919ef1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f290ff-c30f-41fe-9ef6-f098663c8e74', 'volume_name': 'volume-40f290ff-c30f-41fe-9ef6-f098663c8e74', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4cf640-1fe0-4c38-a831-2a542845081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4cf640-1fe0-4c38-a831-2a542845081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a9c841-7d0b-4209-b939-7ececa7ac380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:14 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Volume 40f290ff-c30f-41fe-9ef6-f098663c8e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f290ff-c30f-41fe-9ef6-f098663c8e74', 'volume_size': 1} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1128624283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f290ff-c30f-41fe-9ef6-f098663c8e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c3a14d5bcd41478be7b3ad53a3f495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:15Z,use_quota=True,user_id='075425e16ff84334b62a4172711c05e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Creating volume 40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:14 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:14 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97" returned: 0 in 0.455s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:14 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 1073741824 Sep 30 22:26:14 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97" released by "delete_volume" :: held 1.419s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Created reservations ['caaca12b-7916-4117-947d-6db5a26f41f1', '17270bf9-b0cc-445a-afea-d85b7901cff4', 'c3a14c4d-b231-4459-92f5-f8507707413c', '57881a85-dda7-474b-8318-7accee9af65f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:14 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:26:14 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:15 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.302s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:26:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Deleted volume successfully. Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-57e88297-ff90-4b58-ad04-746e93ac4740 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-3f3fa4ff-1ab6-483b-a5aa-ea1bd7f1cb97-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:15 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 1073741824" returned: 0 in 0.513s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:15 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 Sep 30 22:26:15 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-9f9e3a5a-f551-4ebf-bd2c-0779274bc473-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:15 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74" returned: 0 in 0.260s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-9f9e3a5a-f551-4ebf-bd2c-0779274bc473-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a9c841-7d0b-4209-b939-7ececa7ac380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f290ff-c30f-41fe-9ef6-f098663c8e74', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beec6039-4eb5-4fa2-a7ac-44e75207f259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Volume volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 (40f290ff-c30f-41fe-9ef6-f098663c8e74): created successfully Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beec6039-4eb5-4fa2-a7ac-44e75207f259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Flow 'volume_create_manager' (64b96ddb-2b7f-4e54-90c1-15ab250367a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-quobyte-9f9e3a5a-f551-4ebf-bd2c-0779274bc473" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-09705c38-feac-431b-bf16-5472bf4f6c87 tempest-VolumesActionsTest-995616748 None] Created volume successfully. Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-9f9e3a5a-f551-4ebf-bd2c-0779274bc473" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[003e492f-608c-429b-b4e0-93b171a61cde]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Acquiring lock "cinder-beb4a922-d47c-4e16-9409-bbc9c6d6c903-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Lock "cinder-beb4a922-d47c-4e16-9409-bbc9c6d6c903-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Acquiring lock "cinder-quobyte-beb4a922-d47c-4e16-9409-bbc9c6d6c903" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-beb4a922-d47c-4e16-9409-bbc9c6d6c903" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1826fc3-e941-441d-8c43-956d4bba5e1c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:15 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 Sep 30 22:26:15 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:15 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 Sep 30 22:26:15 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:16 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473" returned: 0 in 0.384s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:16 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473 Sep 30 22:26:16 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:16 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903" returned: 0 in 0.375s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:16 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903 Sep 30 22:26:16 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:16 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9f9e3a5a-f551-4ebf-bd2c-0779274bc473" returned: 0 in 0.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-9f9e3a5a-f551-4ebf-bd2c-0779274bc473" released by "delete_volume" :: held 0.691s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Created reservations ['d8c6f03d-8c2a-4530-b15e-2a651d8e8b44', '892d4ad2-b0c5-4f69-93f2-c7bc2520e583', '90e3ae87-9951-4dd9-a2cd-1f8f65e28633', '712f75ce-9b8f-465a-b1c5-2b97e4cd0001'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:26:16 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-beb4a922-d47c-4e16-9409-bbc9c6d6c903" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-beb4a922-d47c-4e16-9409-bbc9c6d6c903" released by "delete_volume" :: held 0.670s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Created reservations ['073d3064-9111-4e35-9279-1007f6032b2e', '3cca5486-79c5-4e20-8ffd-a404aca796db', '19568d3c-18d6-447c-8683-9db634dfc03b', '44d699ba-7bb3-4faf-989e-f5d7a2017abc'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:26:16 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:26:16 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:16 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:26:16 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-228fdeed-4159-40bc-8b2c-bfc28df86c50-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-228fdeed-4159-40bc-8b2c-bfc28df86c50-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-quobyte-228fdeed-4159-40bc-8b2c-bfc28df86c50" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-228fdeed-4159-40bc-8b2c-bfc28df86c50" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:16 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.344s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:26:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Deleted volume successfully. Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f935a711-12a9-4e17-85ca-615e26b98ba8]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d8ac9194-be95-4944-9c17-bd1f087fba2b tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-9f9e3a5a-f551-4ebf-bd2c-0779274bc473-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:17 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.345s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:26:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Deleted volume successfully. Sep 30 22:26:17 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 Sep 30 22:26:17 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20960cb-7813-40a8-8f8c-e326d2021f95 tempest-TestStampPattern-1401913109 None] Lock "cinder-beb4a922-d47c-4e16-9409-bbc9c6d6c903-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Acquiring lock "cinder-53dd95c9-1c8f-46d3-81ef-92c639a4d54e-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Lock "cinder-53dd95c9-1c8f-46d3-81ef-92c639a4d54e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Acquiring lock "cinder-quobyte-3ae16b2a-8990-4262-a2ce-c459d63f901b" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-3ae16b2a-8990-4262-a2ce-c459d63f901b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Acquiring lock "cinder-quobyte-53dd95c9-1c8f-46d3-81ef-92c639a4d54e" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-53dd95c9-1c8f-46d3-81ef-92c639a4d54e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Deleting offline snapshot 53dd95c9-1c8f-46d3-81ef-92c639a4d54e of volume 3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:26:17 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] snapshot_file for this snap is: volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50" returned: 0 in 0.475s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdede030-029d-485a-bf28-35e1a4359239]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:17 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50 Sep 30 22:26:17 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:17 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e Sep 30 22:26:17 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:17 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-228fdeed-4159-40bc-8b2c-bfc28df86c50" returned: 0 in 0.344s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-228fdeed-4159-40bc-8b2c-bfc28df86c50" released by "delete_volume" :: held 0.906s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Created reservations ['79c5ca17-1f93-4a75-8e9e-de7ebcf160b6', '9208a363-2fb5-4a41-b33f-1717cd7d58c1', '96c10f69-e044-499a-ae76-b4df848e938e', 'a18ab27c-ee6b-4f28-b363-a54fa7a3cbfa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:17 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e" returned: 0 in 0.529s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ae16b2a-8990-4262-a2ce-c459d63f901b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:26:17 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:26:17 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-308a2934-1d60-4cb2-81bd-92b33977d8c2-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[08176c91-e281-4ed5-ab64-912a86e6a08a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-308a2934-1d60-4cb2-81bd-92b33977d8c2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-quobyte-308a2934-1d60-4cb2-81bd-92b33977d8c2" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-308a2934-1d60-4cb2-81bd-92b33977d8c2" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:18 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b Sep 30 22:26:18 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed506bf2-e6f0-4dd7-9b6a-369362a5f250]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:18 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.296s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:26:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Deleted volume successfully. Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2a53c7d-3145-4909-9d28-da7f30ed3412 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-228fdeed-4159-40bc-8b2c-bfc28df86c50-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:18 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 Sep 30 22:26:18 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:18 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:18 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b" returned: 0 in 0.609s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2" returned: 0 in 0.469s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:18 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e Sep 30 22:26:18 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:18 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2 Sep 30 22:26:18 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:18 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-308a2934-1d60-4cb2-81bd-92b33977d8c2" returned: 0 in 0.330s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-308a2934-1d60-4cb2-81bd-92b33977d8c2" released by "delete_volume" :: held 0.860s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:19 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Created reservations ['ce645e95-f573-47c1-aff4-b32f47b36e9c', '9d3db2e9-7d9f-4afb-bca9-bd9010e74039', '515456f1-8d74-4791-b69b-3065db754f10', 'dc68f518-7294-451a-835c-5746baf824fc'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:26:19 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e Sep 30 22:26:19 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:19 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:26:19 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:19 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b.53dd95c9-1c8f-46d3-81ef-92c639a4d54e" returned: 0 in 0.412s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-53dd95c9-1c8f-46d3-81ef-92c639a4d54e" released by "_delete_snapshot" :: held 2.131s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-3ae16b2a-8990-4262-a2ce-c459d63f901b" released by "delete_snapshot" :: held 2.162s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:19 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.334s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:26:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Deleted volume successfully. Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf608c67-29c2-4446-a8b4-c6889528669d tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-308a2934-1d60-4cb2-81bd-92b33977d8c2-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Created reservations ['165c2efb-3fcf-4e60-bb8e-1858bb865da5', 'db82be29-2580-40e5-8ad7-d987f814b878', 'ec40771b-4c89-45ad-ba9a-6c7bc1ee6781', '7e56a98f-8ff1-4b14-bf50-4cf45ccfacae'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:26:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Delete snapshot completed successfully. Sep 30 22:26:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-77fbd938-432e-4e7e-83cd-22492f9aebc7 tempest-TestStampPattern-1401913109 None] Lock "cinder-53dd95c9-1c8f-46d3-81ef-92c639a4d54e-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-29d0f9e8-d8bd-4ace-acff-514cdef50118-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-29d0f9e8-d8bd-4ace-acff-514cdef50118-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "cinder-quobyte-29d0f9e8-d8bd-4ace-acff-514cdef50118" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-29d0f9e8-d8bd-4ace-acff-514cdef50118" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3031fc-25e5-4290-a582-96c6836f494d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:20 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 Sep 30 22:26:20 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:20 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118" returned: 0 in 0.463s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:21 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118 Sep 30 22:26:21 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:21 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-29d0f9e8-d8bd-4ace-acff-514cdef50118" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-quobyte-29d0f9e8-d8bd-4ace-acff-514cdef50118" released by "delete_volume" :: held 0.800s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Created reservations ['1d90c556-12d9-4366-9836-2a10d124fec9', 'a72088c6-a7ff-4379-9552-158bb2c0da6f', '8d66281d-0b25-43db-9d3d-d72c0c020ae7', 'bee2627a-aa23-44a4-870b-a7c1056f792f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:21 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:26:21 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:21 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.400s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:26:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Deleted volume successfully. Sep 30 22:26:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f22cc0db-7a99-448e-a3de-369300743c69 tempest-CreateVolumesFromImageTest-1289319 None] Lock "cinder-29d0f9e8-d8bd-4ace-acff-514cdef50118-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Acquiring lock "cinder-3ae16b2a-8990-4262-a2ce-c459d63f901b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Lock "cinder-3ae16b2a-8990-4262-a2ce-c459d63f901b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Acquiring lock "cinder-quobyte-3ae16b2a-8990-4262-a2ce-c459d63f901b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-3ae16b2a-8990-4262-a2ce-c459d63f901b" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0fb8d2-2ad4-4303-bb03-4d21b922316c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:27 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b Sep 30 22:26:27 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:27 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b" returned: 0 in 0.494s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:27 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b Sep 30 22:26:27 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:27 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3ae16b2a-8990-4262-a2ce-c459d63f901b" returned: 0 in 0.330s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Lock "cinder-quobyte-3ae16b2a-8990-4262-a2ce-c459d63f901b" released by "delete_volume" :: held 0.890s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Created reservations ['fccd9a62-aa50-40c1-8dfc-4417f68ca17c', 'df25773c-ecf4-4e18-95b1-72f161a46438', '31b92410-6d6b-4048-8392-77301fab1dea', '277527f1-af9e-4922-b48c-dd18795381a9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:28 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:26:28 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6c13563f-18ae-4368-8504-983ef61c110a tempest-VolumesActionsTest-995616748 None] Acquiring lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74" by "attach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6c13563f-18ae-4368-8504-983ef61c110a tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74" acquired by "attach_volume" :: waited 0.047s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6c13563f-18ae-4368-8504-983ef61c110a tempest-VolumesActionsTest-995616748 None] Attaching volume 40f290ff-c30f-41fe-9ef6-f098663c8e74 to instance be0957d6-dee2-4433-8798-f19e1d61c3e1 at mountpoint /dev/vdb on host None. Sep 30 22:26:28 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.545s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:26:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Deleted volume successfully. Sep 30 22:26:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6c13563f-18ae-4368-8504-983ef61c110a tempest-VolumesActionsTest-995616748 None] Attach volume completed successfully. Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b79cae6c-d2d3-473f-91bb-7e7b7410e717 tempest-TestStampPattern-1401913109 None] Lock "cinder-3ae16b2a-8990-4262-a2ce-c459d63f901b-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6c13563f-18ae-4368-8504-983ef61c110a tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74" released by "attach_volume" :: held 0.235s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59a6cfe2-45c7-4d3a-9a89-7ccdc8a02413 tempest-VolumesActionsTest-995616748 None] Acquiring lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74-detach_volume" by "detach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59a6cfe2-45c7-4d3a-9a89-7ccdc8a02413 tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-59a6cfe2-45c7-4d3a-9a89-7ccdc8a02413 tempest-VolumesActionsTest-995616748 None] Detaching volume 40f290ff-c30f-41fe-9ef6-f098663c8e74 from instance be0957d6-dee2-4433-8798-f19e1d61c3e1. Sep 30 22:26:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-59a6cfe2-45c7-4d3a-9a89-7ccdc8a02413 tempest-VolumesActionsTest-995616748 None] Detach volume completed successfully. Sep 30 22:26:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59a6cfe2-45c7-4d3a-9a89-7ccdc8a02413 tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Flow 'volume_create_manager' (d4f941f5-787a-4c58-a189-74b1f6e22563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8a288d-5bec-4496-a4ef-812975b376bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8a288d-5bec-4496-a4ef-812975b376bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2054745108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09d5954-891b-4548-9614-6796d5dddbbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f3b05d06fd46d0b55cd85e5b53f5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:30Z,use_quota=True,user_id='28d06e1f098e4e8ead057eb0124ceec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ad82f5-95f0-496d-a526-5a958c4636b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ad82f5-95f0-496d-a526-5a958c4636b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dca4567-37a5-4f50-8fa0-01b5b10748b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dca4567-37a5-4f50-8fa0-01b5b10748b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09d5954-891b-4548-9614-6796d5dddbbd', 'volume_name': 'volume-e09d5954-891b-4548-9614-6796d5dddbbd', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cbd987-3576-4599-a915-3effe3e61060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cbd987-3576-4599-a915-3effe3e61060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3fce27-deb5-4893-80c6-b34d1120f472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Volume e09d5954-891b-4548-9614-6796d5dddbbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09d5954-891b-4548-9614-6796d5dddbbd', 'volume_size': 1} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2054745108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09d5954-891b-4548-9614-6796d5dddbbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f3b05d06fd46d0b55cd85e5b53f5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:30Z,use_quota=True,user_id='28d06e1f098e4e8ead057eb0124ceec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Creating volume e09d5954-891b-4548-9614-6796d5dddbbd {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:30 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:30 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd 1073741824 Sep 30 22:26:30 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Flow 'volume_create_manager' (f90ad93f-a082-4e3d-9e27-23c1004edfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f785126d-c136-4e1a-bd71-e10dc5d2a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f785126d-c136-4e1a-bd71-e10dc5d2a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a721be24-34dd-4d70-866f-17cd19b845d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70bfe52c4d74b3e8299b2cf2c7ef9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:31Z,use_quota=True,user_id='922232ca5bcb47da834dea984117a88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e183fc9-7fe1-4b02-9385-243761b4d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e183fc9-7fe1-4b02-9385-243761b4d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35f8898-3cea-4f31-80b7-8c446b9b4d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:26:31 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd 1073741824" returned: 0 in 0.853s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:31 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd Sep 30 22:26:31 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35f8898-3cea-4f31-80b7-8c446b9b4d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a721be24-34dd-4d70-866f-17cd19b845d1', 'volume_name': 'volume-a721be24-34dd-4d70-866f-17cd19b845d1', 'volume_size': 1, 'image_id': '253e5bef-663b-4122-aa1f-4bd7aa082846', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/253e5bef-663b-4122-aa1f-4bd7aa082846', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2b810134f4a1ccc12d5d788737edb93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f70bfe52c4d74b3e8299b2cf2c7ef9ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30123f3fdd9befe9da6fe572e48d2a68d3d20c7c943e3c5586a76364fc56a03cc04385352b32f4c450214e31380e6d8d3ab020895c2725f81908d26f0b8bb946', 'id': '253e5bef-663b-4122-aa1f-4bd7aa082846', 'created_at': datetime.datetime(2026, 9, 30, 20, 26, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 26, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/253e5bef-663b-4122-aa1f-4bd7aa082846/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523cf702-50d6-45bb-977f-5abf90057a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523cf702-50d6-45bb-977f-5abf90057a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb40949-dd5d-4aa8-bcd6-86242aca9a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Volume a721be24-34dd-4d70-866f-17cd19b845d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a721be24-34dd-4d70-866f-17cd19b845d1', 'volume_size': 1, 'image_id': '253e5bef-663b-4122-aa1f-4bd7aa082846', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/253e5bef-663b-4122-aa1f-4bd7aa082846', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2b810134f4a1ccc12d5d788737edb93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f70bfe52c4d74b3e8299b2cf2c7ef9ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30123f3fdd9befe9da6fe572e48d2a68d3d20c7c943e3c5586a76364fc56a03cc04385352b32f4c450214e31380e6d8d3ab020895c2725f81908d26f0b8bb946', 'id': '253e5bef-663b-4122-aa1f-4bd7aa082846', 'created_at': datetime.datetime(2026, 9, 30, 20, 26, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 26, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/253e5bef-663b-4122-aa1f-4bd7aa082846/file', 'properties': {}}, 'image_service': } Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Trying to clone a721be24-34dd-4d70-866f-17cd19b845d1 from image 253e5bef-663b-4122-aa1f-4bd7aa082846 at location (None, [{'url': 'file:///opt/stack/data/glance/images/253e5bef-663b-4122-aa1f-4bd7aa082846', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:26:31 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd" returned: 0 in 0.388s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:26:31 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Image download 0.00 MB at 0.00 MB/s Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3fce27-deb5-4893-80c6-b34d1120f472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09d5954-891b-4548-9614-6796d5dddbbd', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7c18a0-0b25-4e08-ab51-dfaa38e90da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Volume volume-e09d5954-891b-4548-9614-6796d5dddbbd (e09d5954-891b-4548-9614-6796d5dddbbd): created successfully Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7c18a0-0b25-4e08-ab51-dfaa38e90da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Flow 'volume_create_manager' (d4f941f5-787a-4c58-a189-74b1f6e22563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-43c95900-5d8e-413a-9ddd-e1b20202976a tempest-AttachVolumeShelveTestJSON-1897059927 None] Created volume successfully. Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b26bb07-8eeb-4dbc-8f87-2691dbc0f735]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:31 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD Sep 30 22:26:31 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:32 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:32 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD Sep 30 22:26:32 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:32 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:26:32 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Temporary image 253e5bef-663b-4122-aa1f-4bd7aa082846 is fetched for user 922232ca5bcb47da834dea984117a88d. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:26:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[973be84f-39bc-4cea-a1c8-14d5d9e5a042]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:32 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD Sep 30 22:26:32 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:33 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:33 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD Sep 30 22:26:33 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:33 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a721be24-34dd-4d70-866f-17cd19b845d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f70bfe52c4d74b3e8299b2cf2c7ef9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:31Z,use_quota=True,user_id='922232ca5bcb47da834dea984117a88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Creating volume a721be24-34dd-4d70-866f-17cd19b845d1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:33 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:33 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 1073741824 Sep 30 22:26:33 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:34 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 1073741824" returned: 0 in 0.696s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:34 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 Sep 30 22:26:34 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:34 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1" returned: 0 in 0.330s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:34 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Attempting download of 253e5bef-663b-4122-aa1f-4bd7aa082846 ((None, [{'url': 'file:///opt/stack/data/glance/images/253e5bef-663b-4122-aa1f-4bd7aa082846', 'metadata': {}}])) to volume a721be24-34dd-4d70-866f-17cd19b845d1. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:26:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5466b5e-0e65-4457-808c-7330b62ac4c0]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_253e5bef-663b-4122-aa1f-4bd7aa082846_alyee695 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:34 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_253e5bef-663b-4122-aa1f-4bd7aa082846_alyee695 Sep 30 22:26:34 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:35 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_253e5bef-663b-4122-aa1f-4bd7aa082846_alyee695" returned: 0 in 0.576s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_253e5bef-663b-4122-aa1f-4bd7aa082846_alyee695 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:35 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_253e5bef-663b-4122-aa1f-4bd7aa082846_alyee695 Sep 30 22:26:35 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:35 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_253e5bef-663b-4122-aa1f-4bd7aa082846_alyee695" returned: 1 in 0.550s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_253e5bef-663b-4122-aa1f-4bd7aa082846_alyee695' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:26:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08ea15e-3f76-4842-98d7-f89f53189877]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:35 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD Sep 30 22:26:35 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:36 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:36 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD Sep 30 22:26:36 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:36 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD" returned: 1 in 0.547s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:26:36 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] 253e5bef-663b-4122-aa1f-4bd7aa082846 was raw, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:26:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:36 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 Sep 30 22:26:36 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:37 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1" returned: 0 in 0.833s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:37 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_253e5bef-663b-4122-aa1f-4bd7aa082846_c79ofzbtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:26:37 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 22:26:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:37 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 1G Sep 30 22:26:37 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:38 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 1G" returned: 0 in 0.592s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Downloaded image 253e5bef-663b-4122-aa1f-4bd7aa082846 ((None, [{'url': 'file:///opt/stack/data/glance/images/253e5bef-663b-4122-aa1f-4bd7aa082846', 'metadata': {}}])) to volume a721be24-34dd-4d70-866f-17cd19b845d1 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Temporary image 253e5bef-663b-4122-aa1f-4bd7aa082846 for user 922232ca5bcb47da834dea984117a88d is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Marking volume a721be24-34dd-4d70-866f-17cd19b845d1 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Copying metadata from image 253e5bef-663b-4122-aa1f-4bd7aa082846 to a721be24-34dd-4d70-866f-17cd19b845d1. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Creating volume glance metadata for volume a721be24-34dd-4d70-866f-17cd19b845d1 backed by image 253e5bef-663b-4122-aa1f-4bd7aa082846 with: {'image_id': '253e5bef-663b-4122-aa1f-4bd7aa082846', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a2b810134f4a1ccc12d5d788737edb93', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb40949-dd5d-4aa8-bcd6-86242aca9a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a721be24-34dd-4d70-866f-17cd19b845d1', 'volume_size': 1, 'image_id': '253e5bef-663b-4122-aa1f-4bd7aa082846', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/253e5bef-663b-4122-aa1f-4bd7aa082846', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2b810134f4a1ccc12d5d788737edb93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f70bfe52c4d74b3e8299b2cf2c7ef9ab', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30123f3fdd9befe9da6fe572e48d2a68d3d20c7c943e3c5586a76364fc56a03cc04385352b32f4c450214e31380e6d8d3ab020895c2725f81908d26f0b8bb946', 'id': '253e5bef-663b-4122-aa1f-4bd7aa082846', 'created_at': datetime.datetime(2026, 9, 30, 20, 26, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 26, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/253e5bef-663b-4122-aa1f-4bd7aa082846/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba06b5f-e119-4a52-8170-994ae3713055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Volume volume-a721be24-34dd-4d70-866f-17cd19b845d1 (a721be24-34dd-4d70-866f-17cd19b845d1): created successfully Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba06b5f-e119-4a52-8170-994ae3713055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Flow 'volume_create_manager' (f90ad93f-a082-4e3d-9e27-23c1004edfbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7220a6ea-fe15-4657-9301-e4ad37ffea0c tempest-VolumeImageDependencyTests-303457346 None] Created volume successfully. Sep 30 22:26:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Acquiring lock "cinder-a721be24-34dd-4d70-866f-17cd19b845d1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Lock "cinder-a721be24-34dd-4d70-866f-17cd19b845d1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Acquiring lock "cinder-quobyte-a721be24-34dd-4d70-866f-17cd19b845d1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Lock "cinder-quobyte-a721be24-34dd-4d70-866f-17cd19b845d1" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddb799f-16a7-4350-8e79-9ebf4ff905be]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:39 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 Sep 30 22:26:39 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:40 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1" returned: 0 in 0.655s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:40 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1 Sep 30 22:26:40 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:40 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a721be24-34dd-4d70-866f-17cd19b845d1" returned: 0 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Lock "cinder-quobyte-a721be24-34dd-4d70-866f-17cd19b845d1" released by "delete_volume" :: held 1.132s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Created reservations ['4b21f838-6be9-42e3-a06c-a7b91d340ed9', 'a85459da-8590-4320-a3af-d043f9e4588e', '0177a801-2074-4d0c-acb1-7511001d2026', '4035bc02-8bb8-4dcf-82e8-1085c8319e24'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:41 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:26:41 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:41 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.472s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:26:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Deleted volume successfully. Sep 30 22:26:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-11587d6e-8657-482d-9c78-f0497a65c075 tempest-VolumeImageDependencyTests-303457346 None] Lock "cinder-a721be24-34dd-4d70-866f-17cd19b845d1-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-382492a3-e220-4b05-a917-f126211c02f6 tempest-VolumesActionsTest-995616748 None] Acquiring lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74" by "attach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-382492a3-e220-4b05-a917-f126211c02f6 tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74" acquired by "attach_volume" :: waited 0.045s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-382492a3-e220-4b05-a917-f126211c02f6 tempest-VolumesActionsTest-995616748 None] Attaching volume 40f290ff-c30f-41fe-9ef6-f098663c8e74 to instance 8b9ed637-8603-4c13-8696-8506c5056ddf at mountpoint /dev/vdb on host None. Sep 30 22:26:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-382492a3-e220-4b05-a917-f126211c02f6 tempest-VolumesActionsTest-995616748 None] Attach volume completed successfully. Sep 30 22:26:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-382492a3-e220-4b05-a917-f126211c02f6 tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74" released by "attach_volume" :: held 0.167s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-33936757-c3f1-4050-bbc1-4b18971b4aeb tempest-VolumesActionsTest-995616748 None] Acquiring lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74-detach_volume" by "detach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:26:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-33936757-c3f1-4050-bbc1-4b18971b4aeb tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:26:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-33936757-c3f1-4050-bbc1-4b18971b4aeb tempest-VolumesActionsTest-995616748 None] Detaching volume 40f290ff-c30f-41fe-9ef6-f098663c8e74 from instance 8b9ed637-8603-4c13-8696-8506c5056ddf. Sep 30 22:26:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-33936757-c3f1-4050-bbc1-4b18971b4aeb tempest-VolumesActionsTest-995616748 None] Detach volume completed successfully. Sep 30 22:26:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-33936757-c3f1-4050-bbc1-4b18971b4aeb tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:26:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-cf0e3921-bc41-4951-accb-0002243808a0 req-144b5d21-854f-4671-bdff-77f1ef7dcab5 tempest-AttachVolumeShelveTestJSON-1897059927 None] No connector for attachment 05a826b9-6ef0-44a5-813b-e6d05423a120; skipping storage backend terminate_connection call. {{(pid=87240) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 30 22:26:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-cf0e3921-bc41-4951-accb-0002243808a0 req-144b5d21-854f-4671-bdff-77f1ef7dcab5 tempest-AttachVolumeShelveTestJSON-1897059927 None] Deleting attachment 05a826b9-6ef0-44a5-813b-e6d05423a120. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Flow 'volume_create_manager' (17c9b659-5dbf-43b1-994e-6fc63d01d2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea68d325-57d2-42c7-8955-27231880ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea68d325-57d2-42c7-8955-27231880ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4220ad24-fbc0-4979-8029-52b62357bff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728adc5e7c24c82942c3cfbacde5d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:49Z,use_quota=True,user_id='7599d690964d44f087f23b6068a6088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691f87b6-07a7-4c9b-9949-9793a37cbbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691f87b6-07a7-4c9b-9949-9793a37cbbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13959415-2ee7-48a1-9a2e-efd739deb1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13959415-2ee7-48a1-9a2e-efd739deb1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4220ad24-fbc0-4979-8029-52b62357bff3', 'volume_name': 'volume-4220ad24-fbc0-4979-8029-52b62357bff3', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48af7d6c-9114-470d-b433-b9f7c7fde68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48af7d6c-9114-470d-b433-b9f7c7fde68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84312a71-6275-4af3-a207-bf9847cc2cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Volume 4220ad24-fbc0-4979-8029-52b62357bff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4220ad24-fbc0-4979-8029-52b62357bff3', 'volume_size': 1} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4220ad24-fbc0-4979-8029-52b62357bff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728adc5e7c24c82942c3cfbacde5d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:49Z,use_quota=True,user_id='7599d690964d44f087f23b6068a6088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Creating volume 4220ad24-fbc0-4979-8029-52b62357bff3 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:49 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3 1073741824 Sep 30 22:26:49 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:49 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3 1073741824" returned: 0 in 0.572s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:50 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3 Sep 30 22:26:50 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:50 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84312a71-6275-4af3-a207-bf9847cc2cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4220ad24-fbc0-4979-8029-52b62357bff3', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc35182-fe80-4e0e-882b-59d44af2e698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Volume volume-4220ad24-fbc0-4979-8029-52b62357bff3 (4220ad24-fbc0-4979-8029-52b62357bff3): created successfully Sep 30 22:26:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc35182-fe80-4e0e-882b-59d44af2e698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Flow 'volume_create_manager' (17c9b659-5dbf-43b1-994e-6fc63d01d2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9a080bcc-5a6c-4f3d-b7d7-bd1f03fdbf27 tempest-CinderUnicodeTest-13114580 None] Created volume successfully. Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Flow 'volume_create_manager' (02365a36-ab91-4468-8821-a97678cd1b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20088752-2560-4761-981e-b40b1d0809cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20088752-2560-4761-981e-b40b1d0809cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1347799997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745d3b68-3ab8-45f0-a49d-00311f63f843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728adc5e7c24c82942c3cfbacde5d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:52Z,use_quota=True,user_id='7599d690964d44f087f23b6068a6088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a611956e-427e-407c-a00c-a8b409122c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a611956e-427e-407c-a00c-a8b409122c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190b271d-6b38-465a-9469-3022d1a5f2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190b271d-6b38-465a-9469-3022d1a5f2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745d3b68-3ab8-45f0-a49d-00311f63f843', 'volume_name': 'volume-745d3b68-3ab8-45f0-a49d-00311f63f843', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced105df-078a-4c66-816a-c15edca150a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced105df-078a-4c66-816a-c15edca150a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b35ad0-cc43-473a-9575-f2d58ad3e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Volume 745d3b68-3ab8-45f0-a49d-00311f63f843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745d3b68-3ab8-45f0-a49d-00311f63f843', 'volume_size': 1} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1347799997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745d3b68-3ab8-45f0-a49d-00311f63f843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728adc5e7c24c82942c3cfbacde5d86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:52Z,use_quota=True,user_id='7599d690964d44f087f23b6068a6088e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Creating volume 745d3b68-3ab8-45f0-a49d-00311f63f843 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:26:52 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:52 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 1073741824 Sep 30 22:26:52 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:52 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 1073741824" returned: 0 in 0.537s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:52 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 Sep 30 22:26:52 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:53 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843" returned: 0 in 0.432s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.965s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b35ad0-cc43-473a-9575-f2d58ad3e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745d3b68-3ab8-45f0-a49d-00311f63f843', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8126091f-4d07-46bb-ae47-464e989f381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9a4827-5328-4eff-8495-32204dabf614]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Volume volume-745d3b68-3ab8-45f0-a49d-00311f63f843 (745d3b68-3ab8-45f0-a49d-00311f63f843): created successfully Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8126091f-4d07-46bb-ae47-464e989f381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Flow 'volume_create_manager' (02365a36-ab91-4468-8821-a97678cd1b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-676027e8-e229-4a88-ad81-9b3e47cb99a6 tempest-CinderUnicodeTest-13114580 None] Created volume successfully. Sep 30 22:26:53 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 Sep 30 22:26:53 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:53 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74" returned: 0 in 0.496s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da9c812-b5b9-498c-a78b-ffdc1c817e5f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:54 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 Sep 30 22:26:54 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=84,cinder:UPDATE=116,cinder:INSERT=30,cinder:DELETE=14 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Flow 'volume_create_manager' (62da52fb-30b0-4b6f-ba46-d86444a08abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ac123a-9a0d-4e57-b549-3c22397436b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ac123a-9a0d-4e57-b549-3c22397436b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64b6a8c-ce5d-442a-a971-6946b927a6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d17f433a32141a9912ddbbf4e5e1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:54Z,use_quota=True,user_id='fb1680f27f8a457ebb3bd6afa542ee3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e501f269-fa86-49b7-ad99-b503dde7fcb0),volume_type_id=e501f269-fa86-49b7-ad99-b503dde7fcb0)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5fc47e-4b47-46a5-9a4c-b1d3415053b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5fc47e-4b47-46a5-9a4c-b1d3415053b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7c56b8-e028-4902-b79f-c28e27f2925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:26:54 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74" returned: 0 in 0.472s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.3c8dbed2-3132-454d-8fd9-a2254702e989huaiotg3.img {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:54 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.3c8dbed2-3132-454d-8fd9-a2254702e989huaiotg3.img Sep 30 22:26:54 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7c56b8-e028-4902-b79f-c28e27f2925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c64b6a8c-ce5d-442a-a971-6946b927a6a5', 'volume_name': 'volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5', 'volume_size': 1, 'image_id': 'ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd10207530943d19e5edc459d29ec196e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d17f433a32141a9912ddbbf4e5e1e07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aaf41165b45038359c7197126c0666d03f34a405e6f2c1483e524a42e3c828d3b5096fc7049b85a9fc3db59ccadfce6cd9ddb97b08b2f0d77bb4d06895e9d58', 'id': 'ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'created_at': datetime.datetime(2026, 9, 30, 20, 26, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 26, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce5a35c1-56c3-4b1a-a8af-d8dc2414518b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b871ba-e1f6-4c00-8bec-900c186627d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b871ba-e1f6-4c00-8bec-900c186627d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967c5ab9-44c6-4449-a49a-0342db6e54ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:26:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Volume c64b6a8c-ce5d-442a-a971-6946b927a6a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5', 'volume_size': 1, 'image_id': 'ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd10207530943d19e5edc459d29ec196e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d17f433a32141a9912ddbbf4e5e1e07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aaf41165b45038359c7197126c0666d03f34a405e6f2c1483e524a42e3c828d3b5096fc7049b85a9fc3db59ccadfce6cd9ddb97b08b2f0d77bb4d06895e9d58', 'id': 'ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'created_at': datetime.datetime(2026, 9, 30, 20, 26, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 26, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce5a35c1-56c3-4b1a-a8af-d8dc2414518b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Trying to clone c64b6a8c-ce5d-442a-a971-6946b927a6a5 from image ce5a35c1-56c3-4b1a-a8af-d8dc2414518b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:26:54 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Image download 0.00 MB at 0.00 MB/s Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a7196b-d735-4c37-b47a-daa1653f6fd7]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=105,cinder:UPDATE=104,cinder:INSERT=29,cinder:DELETE=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:26:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:26:54 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD Sep 30 22:26:54 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:55 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:55 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD Sep 30 22:26:55 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:56 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD" returned: 1 in 0.639s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:26:56 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Temporary image ce5a35c1-56c3-4b1a-a8af-d8dc2414518b is fetched for user fb1680f27f8a457ebb3bd6afa542ee3f. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:26:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd61dd7d-cb4e-4b25-8b8f-90a863ca81b9]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:26:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:56 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD Sep 30 22:26:56 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:56 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:26:57 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD Sep 30 22:26:57 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:26:57 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 30 22:26:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD" returned: 1 in 0.594s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:26:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:26:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:02 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.3c8dbed2-3132-454d-8fd9-a2254702e989huaiotg3.img" returned: 0 in 8.375s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe62cfd-3808-413d-92e4-e59fc2c93392]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:02 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 Sep 30 22:27:02 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:03 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:03 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:03 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74" returned: 0 in 0.716s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74, size 1024.00 MB, duration 8.38 sec, destination /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.3c8dbed2-3132-454d-8fd9-a2254702e989huaiotg3.img {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:27:03 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Converted 1024.00 MB image at 122.26 MB/s Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] 3c8dbed2-3132-454d-8fd9-a2254702e989 was raw, no need to convert to raw {{(pid=87240) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 30 22:27:03 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.447s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:27:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:27:13 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:27:13 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=3,cinder:INSERT=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:27:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.455s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Uploaded volume to glance image-id: 3c8dbed2-3132-454d-8fd9-a2254702e989. {{(pid=87240) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 30 22:27:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 27.936s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Creating offline snapshot b1dd9aca-5500-4242-942c-2e691328d47f of volume 745d3b68-3ab8-45f0-a49d-00311f63f843 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:27:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a91de319-4853-4ed8-aed7-43d087488e6f tempest-VolumesActionsTest-995616748 None] Copy volume to image completed successfully. Sep 30 22:27:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d03e39-b63d-4763-af5e-a441a08cf053]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:22 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 Sep 30 22:27:22 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:23 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:23 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f 1G Sep 30 22:27:23 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:23 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f 1G" returned: 0 in 0.377s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-745d3b68-3ab8-45f0-a49d-00311f63f843 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:23 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-745d3b68-3ab8-45f0-a49d-00311f63f843 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f Sep 30 22:27:23 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:23 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-745d3b68-3ab8-45f0-a49d-00311f63f843 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f" returned: 0 in 0.326s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:23 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f is being set with open permissions: ugo+rw Sep 30 22:27:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:23 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f Sep 30 22:27:23 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:24 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f" returned: 0 in 0.289s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:24 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.info Sep 30 22:27:24 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:24 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.info" returned: 0 in 0.297s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:24 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.info is being set with open permissions: ugo+rw Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:24 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.info Sep 30 22:27:24 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:24 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.info" returned: 0 in 0.289s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.437s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64b6a8c-ce5d-442a-a971-6946b927a6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d17f433a32141a9912ddbbf4e5e1e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:26:54Z,use_quota=True,user_id='fb1680f27f8a457ebb3bd6afa542ee3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e501f269-fa86-49b7-ad99-b503dde7fcb0),volume_type_id=e501f269-fa86-49b7-ad99-b503dde7fcb0)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Creating volume c64b6a8c-ce5d-442a-a971-6946b927a6a5 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:24 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:24 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 1073741824 Sep 30 22:27:24 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7aef3094-996c-4cca-a43c-d73ab0cc4f32 tempest-CinderUnicodeTest-13114580 None] Create snapshot completed successfully Sep 30 22:27:25 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 1073741824" returned: 0 in 0.440s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Acquiring lock "cinder-b1dd9aca-5500-4242-942c-2e691328d47f-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:25 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 Sep 30 22:27:25 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Lock "cinder-b1dd9aca-5500-4242-942c-2e691328d47f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Acquiring lock "cinder-quobyte-745d3b68-3ab8-45f0-a49d-00311f63f843" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Lock "cinder-quobyte-745d3b68-3ab8-45f0-a49d-00311f63f843" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Acquiring lock "cinder-quobyte-b1dd9aca-5500-4242-942c-2e691328d47f" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Lock "cinder-quobyte-b1dd9aca-5500-4242-942c-2e691328d47f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Deleting offline snapshot b1dd9aca-5500-4242-942c-2e691328d47f of volume 745d3b68-3ab8-45f0-a49d-00311f63f843 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] snapshot_file for this snap is: volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb45e4e-fa9e-4f94-b238-46adb20494d0]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:25 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f Sep 30 22:27:25 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:25 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5" returned: 0 in 0.285s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.875s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58a5716-ab06-4d3e-b31c-67b2ee7b9c31]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Attempting download of ce5a35c1-56c3-4b1a-a8af-d8dc2414518b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'metadata': {}}])) to volume c64b6a8c-ce5d-442a-a971-6946b927a6a5. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f02bbf-4d2c-4e6f-902f-6773f73cbc71]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_344wrfp9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:25 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 Sep 30 22:27:25 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:25 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_344wrfp9 Sep 30 22:27:25 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:25 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f" returned: 0 in 0.406s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-745d3b68-3ab8-45f0-a49d-00311f63f843(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cd3f73-ad0f-49b7-b603-a67d8477a54e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:25 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 Sep 30 22:27:25 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:26 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74" returned: 0 in 0.414s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[11304a9c-9d98-439a-8822-f6c96538a768]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:26 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_344wrfp9" returned: 0 in 0.365s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_344wrfp9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:26 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 Sep 30 22:27:26 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:26 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_344wrfp9 Sep 30 22:27:26 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:26 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843" returned: 0 in 0.415s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:26 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f Sep 30 22:27:26 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:26 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_344wrfp9" returned: 1 in 0.417s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_344wrfp9' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d54fbf6-d471-4534-a8e7-32c737a334f2]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:26 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74" returned: 0 in 0.450s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:26 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img Sep 30 22:27:26 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:26 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD Sep 30 22:27:26 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:26 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f" returned: 0 in 0.495s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:26 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f Sep 30 22:27:26 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:27 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:27 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843.b1dd9aca-5500-4242-942c-2e691328d47f" returned: 0 in 0.374s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Lock "cinder-quobyte-b1dd9aca-5500-4242-942c-2e691328d47f" released by "_delete_snapshot" :: held 1.929s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Lock "cinder-quobyte-745d3b68-3ab8-45f0-a49d-00311f63f843" released by "delete_snapshot" :: held 1.976s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:27 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD Sep 30 22:27:27 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Created reservations ['fd9caa45-27ef-4c23-9664-ba527c9b41f9', 'fff53968-47aa-47d1-84d3-435db8968cdd', '69f6b641-fe77-4587-a273-11d72d16535a', '7d852543-f509-4699-9ad5-6c6c5a6b265f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Delete snapshot completed successfully. Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b238d8f1-39d9-462e-81e1-3c79931fbfcf tempest-CinderUnicodeTest-13114580 None] Lock "cinder-b1dd9aca-5500-4242-942c-2e691328d47f-delete_snapshot" released by "delete_snapshot" :: held 2.348s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:27 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD" returned: 1 in 0.765s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] ce5a35c1-56c3-4b1a-a8af-d8dc2414518b was raw, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:27:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:27 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 Sep 30 22:27:27 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "cinder-745d3b68-3ab8-45f0-a49d-00311f63f843-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Lock "cinder-745d3b68-3ab8-45f0-a49d-00311f63f843-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "cinder-quobyte-745d3b68-3ab8-45f0-a49d-00311f63f843" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Lock "cinder-quobyte-745d3b68-3ab8-45f0-a49d-00311f63f843" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9a8910-6e23-4dd1-aba5-6c4c0887deea]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:29 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 Sep 30 22:27:29 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:29 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5" returned: 0 in 1.505s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:29 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ce5a35c1-56c3-4b1a-a8af-d8dc2414518b_8dn4z2hwdevstack@QuobyteHD, size 0.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:27:29 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 22:27:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:29 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 1G Sep 30 22:27:29 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:29 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843" returned: 0 in 0.994s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:30 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843 Sep 30 22:27:30 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:30 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 1G" returned: 0 in 1.039s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Downloaded image ce5a35c1-56c3-4b1a-a8af-d8dc2414518b ((None, [{'url': 'file:///opt/stack/data/glance/images/ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'metadata': {}}])) to volume c64b6a8c-ce5d-442a-a971-6946b927a6a5 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Temporary image ce5a35c1-56c3-4b1a-a8af-d8dc2414518b for user fb1680f27f8a457ebb3bd6afa542ee3f is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Marking volume c64b6a8c-ce5d-442a-a971-6946b927a6a5 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Copying metadata from image ce5a35c1-56c3-4b1a-a8af-d8dc2414518b to c64b6a8c-ce5d-442a-a971-6946b927a6a5. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Creating volume glance metadata for volume c64b6a8c-ce5d-442a-a971-6946b927a6a5 backed by image ce5a35c1-56c3-4b1a-a8af-d8dc2414518b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd10207530943d19e5edc459d29ec196e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:27:30 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-745d3b68-3ab8-45f0-a49d-00311f63f843" returned: 0 in 0.441s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Lock "cinder-quobyte-745d3b68-3ab8-45f0-a49d-00311f63f843" released by "delete_volume" :: held 1.638s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967c5ab9-44c6-4449-a49a-0342db6e54ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5', 'volume_size': 1, 'image_id': 'ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd10207530943d19e5edc459d29ec196e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7d17f433a32141a9912ddbbf4e5e1e07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aaf41165b45038359c7197126c0666d03f34a405e6f2c1483e524a42e3c828d3b5096fc7049b85a9fc3db59ccadfce6cd9ddb97b08b2f0d77bb4d06895e9d58', 'id': 'ce5a35c1-56c3-4b1a-a8af-d8dc2414518b', 'created_at': datetime.datetime(2026, 9, 30, 20, 26, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 26, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ce5a35c1-56c3-4b1a-a8af-d8dc2414518b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696d663b-f1cd-4055-b06c-b10ffffb2f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Volume volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 (c64b6a8c-ce5d-442a-a971-6946b927a6a5): created successfully Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (696d663b-f1cd-4055-b06c-b10ffffb2f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Flow 'volume_create_manager' (62da52fb-30b0-4b6f-ba46-d86444a08abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:30 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Created reservations ['68d83386-1e24-462f-bf97-b4caca3d846c', 'c98432b1-79d9-41b2-922f-7b98971043fd', 'c2254978-bb5f-4937-995c-b6a8e89f34cf', '337c8461-95eb-476e-9808-7edfafe68b70'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-116ccc9e-c4dd-4923-b320-5732302fac5d tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Created volume successfully. Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:31 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:31 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "cinder-4220ad24-fbc0-4979-8029-52b62357bff3-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Lock "cinder-4220ad24-fbc0-4979-8029-52b62357bff3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Acquiring lock "cinder-c64b6a8c-ce5d-442a-a971-6946b927a6a5-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:31 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "cinder-quobyte-4220ad24-fbc0-4979-8029-52b62357bff3" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.573s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "cinder-c64b6a8c-ce5d-442a-a971-6946b927a6a5-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Deleted volume successfully. Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Lock "cinder-quobyte-4220ad24-fbc0-4979-8029-52b62357bff3" acquired by "delete_volume" :: waited 0.050s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[79691595-4cff-4ad4-bec8-743e5abeeb24]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37f0255a-4ac0-4f67-b28d-c95738633a26 tempest-CinderUnicodeTest-13114580 None] Lock "cinder-745d3b68-3ab8-45f0-a49d-00311f63f843-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Acquiring lock "cinder-quobyte-c64b6a8c-ce5d-442a-a971-6946b927a6a5" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:31 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3 Sep 30 22:27:31 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "cinder-quobyte-c64b6a8c-ce5d-442a-a971-6946b927a6a5" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee35f95d-558a-4e9d-865f-2fbe0e3e681a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:32 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 Sep 30 22:27:32 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:32 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3" returned: 0 in 0.896s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:32 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3 Sep 30 22:27:32 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:33 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4220ad24-fbc0-4979-8029-52b62357bff3" returned: 0 in 0.554s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:33 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5" returned: 0 in 1.206s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Lock "cinder-quobyte-4220ad24-fbc0-4979-8029-52b62357bff3" released by "delete_volume" :: held 1.577s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:33 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5 Sep 30 22:27:33 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Created reservations ['de0d5689-b3a9-4164-9bb8-30216546a706', '72adad58-73f1-4dc4-a9fa-819a5fe15a41', 'bf02fe3c-5b45-4efa-a85e-f5ef81ec258d', '3abc701b-d6ae-4cbc-82e0-3ae79d3a582a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:33 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:33 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:33 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c64b6a8c-ce5d-442a-a971-6946b927a6a5" returned: 0 in 0.524s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "cinder-quobyte-c64b6a8c-ce5d-442a-a971-6946b927a6a5" released by "delete_volume" :: held 1.846s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:33 devstack cinder-volume[87240]: WARNING cinder.quota [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:27:33 devstack cinder-volume[87240]: WARNING cinder.quota [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:27:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Created reservations ['3b62efef-8218-4692-8892-ade5fad8503a', 'a12bb173-e625-4ef7-a355-1c9131f2cf28', 'c8543f9a-03e5-4a07-a07b-2f08d0a1634a', '3d4bed6e-4b3e-4b61-bd48-727961fdf24d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:34 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.737s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:34 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:34 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Deleted volume successfully. Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6e8ecb09-50c0-42d7-b64b-ad08cd8e8055 tempest-CinderUnicodeTest-13114580 None] Lock "cinder-4220ad24-fbc0-4979-8029-52b62357bff3-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Acquiring lock "cinder-e09d5954-891b-4548-9614-6796d5dddbbd-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "cinder-e09d5954-891b-4548-9614-6796d5dddbbd-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Acquiring lock "cinder-quobyte-e09d5954-891b-4548-9614-6796d5dddbbd" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "cinder-quobyte-e09d5954-891b-4548-9614-6796d5dddbbd" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[209766e1-a8e5-484e-9dae-e11831306c3d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:34 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.642s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Deleted volume successfully. Sep 30 22:27:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f81a9748-7ed2-428e-bde1-8ce00e89869f tempest-VolumeAndVolumeTypeFromImageTest-109153240 None] Lock "cinder-c64b6a8c-ce5d-442a-a971-6946b927a6a5-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:34 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd Sep 30 22:27:34 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:35 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd" returned: 0 in 0.582s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:35 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd Sep 30 22:27:35 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:35 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e09d5954-891b-4548-9614-6796d5dddbbd" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "cinder-quobyte-e09d5954-891b-4548-9614-6796d5dddbbd" released by "delete_volume" :: held 1.083s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:35 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Created reservations ['3df91741-be49-4678-ae69-ac796f7ca4e4', '555eac1a-7a09-494c-b44a-b23f302330be', 'a0f40f1e-5754-4231-b68b-90be3306628e', 'ff2212db-af82-484d-b202-2e6555cdedfe'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:36 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:36 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:36 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img" returned: 0 in 9.674s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f292c797-7d78-4643-b508-45c7762f827f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:36 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 Sep 30 22:27:36 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:36 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.313s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Deleted volume successfully. Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8076d7da-5d83-4db4-a084-f4196c057ece tempest-AttachVolumeShelveTestJSON-1897059927 None] Lock "cinder-e09d5954-891b-4548-9614-6796d5dddbbd-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:36 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74" returned: 0 in 0.671s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:36 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74, size 1024.00 MB, duration 9.68 sec, destination /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:27:36 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Converted 1024.00 MB image at 105.82 MB/s Sep 30 22:27:37 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] 2b02fffa-01f1-41c5-9c91-fdfba11d17c2 was raw, converting to qcow2 {{(pid=87240) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 30 22:27:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c33e8-5be5-4f3f-9804-9868fcb3d914]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:37 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img Sep 30 22:27:37 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:37 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img" returned: 0 in 0.402s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:37 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img Sep 30 22:27:37 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:38 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img" returned: 1 in 0.365s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:27:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img /opt/stack/data/cinder/conversion/vol_upload_xpj8tamz {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:38 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img /opt/stack/data/cinder/conversion/vol_upload_xpj8tamz Sep 30 22:27:38 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:38 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img /opt/stack/data/cinder/conversion/vol_upload_xpj8tamz" returned: 0 in 0.338s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:38 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Image conversion details: src /opt/stack/data/cinder/conversion/40f290ff-c30f-41fe-9ef6-f098663c8e74.temp_image.2b02fffa-01f1-41c5-9c91-fdfba11d17c23rgbj78u.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_xpj8tamz {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:27:38 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 30 22:27:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[495b9b9c-9ffc-46b3-b4c1-747d0f598bc1]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xpj8tamz {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:38 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xpj8tamz Sep 30 22:27:38 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:38 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xpj8tamz" returned: 0 in 0.398s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.253s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Uploaded volume to glance image-id: 2b02fffa-01f1-41c5-9c91-fdfba11d17c2. {{(pid=87240) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 30 22:27:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6a7e2a3b-afa2-49a5-91b6-0fb8f2828c86 tempest-VolumesActionsTest-995616748 None] Copy volume to image completed successfully. Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (c8988c10-47b2-47e5-a8d3-49b0ce098c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f082a4c-3e94-4b13-ad78-4d80194848cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f082a4c-3e94-4b13-ad78-4d80194848cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067810180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd09b83-a2ef-44fa-8a11-98625d98f0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:42Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7752a2-d7fe-483b-934a-0badb6ee2cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7752a2-d7fe-483b-934a-0badb6ee2cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990d58aa-450b-47ee-90f8-3ceb99c44109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990d58aa-450b-47ee-90f8-3ceb99c44109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd09b83-a2ef-44fa-8a11-98625d98f0c9', 'volume_name': 'volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec567ce8-e484-4bbe-ad07-518539966608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec567ce8-e484-4bbe-ad07-518539966608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f07bc11-4bf1-4b63-bfd6-d7c1b5ff1c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume 6cd09b83-a2ef-44fa-8a11-98625d98f0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9', 'volume_size': 1} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067810180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd09b83-a2ef-44fa-8a11-98625d98f0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:42Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Creating volume 6cd09b83-a2ef-44fa-8a11-98625d98f0c9 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:41 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:41 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 1073741824 Sep 30 22:27:41 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:42 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 1073741824" returned: 0 in 0.622s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:42 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 Sep 30 22:27:42 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Acquiring lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Acquiring lock "cinder-quobyte-40f290ff-c30f-41fe-9ef6-f098663c8e74" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:42 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" returned: 0 in 0.396s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f07bc11-4bf1-4b63-bfd6-d7c1b5ff1c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d58c952-1b16-4bcb-b9eb-ea3844479f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Lock "cinder-quobyte-40f290ff-c30f-41fe-9ef6-f098663c8e74" acquired by "delete_volume" :: waited 0.065s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 (6cd09b83-a2ef-44fa-8a11-98625d98f0c9): created successfully Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d58c952-1b16-4bcb-b9eb-ea3844479f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (c8988c10-47b2-47e5-a8d3-49b0ce098c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5b2f89-8a84-4f59-9913-14beac6da865]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-025a27e6-54c4-4515-b744-ea7a7f77ac02 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created volume successfully. Sep 30 22:27:43 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 Sep 30 22:27:43 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:43 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74" returned: 0 in 0.415s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:43 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74 Sep 30 22:27:43 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:43 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-40f290ff-c30f-41fe-9ef6-f098663c8e74" returned: 0 in 0.265s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Lock "cinder-quobyte-40f290ff-c30f-41fe-9ef6-f098663c8e74" released by "delete_volume" :: held 0.763s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Created reservations ['76534ff2-b1ef-424c-882e-8661e2d488d1', '99a3a2b0-663b-48b7-91b1-00505bd0d592', '357632e5-d151-4bdc-af09-bc7b40b8a51a', '6d17a808-8ec9-4c9c-8f7d-fac70bd5068c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:43 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:43 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Creating offline snapshot ac382eec-d0fb-4207-a169-4e486bb6d55c of volume 6cd09b83-a2ef-44fa-8a11-98625d98f0c9 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8288aa-f473-4c6a-87e9-431bf3a7eb09]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:44 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 Sep 30 22:27:44 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:44 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.489s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Deleted volume successfully. Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-577c69ea-b5af-4b32-9043-a6fc788d8828 tempest-VolumesActionsTest-995616748 None] Lock "cinder-40f290ff-c30f-41fe-9ef6-f098663c8e74-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:44 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" returned: 0 in 0.460s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:44 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c 1G Sep 30 22:27:44 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:45 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c 1G" returned: 0 in 0.552s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:45 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c Sep 30 22:27:45 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:45 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:45 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c is being set with open permissions: ugo+rw Sep 30 22:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:45 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c Sep 30 22:27:45 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:45 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c" returned: 0 in 0.302s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:45 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.info Sep 30 22:27:45 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:46 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.info" returned: 0 in 0.342s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:46 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.info is being set with open permissions: ugo+rw Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:46 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.info Sep 30 22:27:46 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:46 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.info" returned: 0 in 0.300s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Flow 'volume_create_manager' (2da397c6-1642-4438-b066-4ffd6d9209f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d945a6c4-795e-448b-abcc-762ce1b21408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-186295ac-8bd9-4bab-be2a-21ba564a33ee tempest-CreateVolumesFromSnapshotTest-1483524277 None] Create snapshot completed successfully Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d945a6c4-795e-448b-abcc-762ce1b21408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317688418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d629b3ba-a008-4f44-bbf4-3cdd4f1691ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5242fda45dc641b0aa9f2589ffd92cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:47Z,use_quota=True,user_id='4edebbcf29884a51b4df216c804cfe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e6e3db-bf47-406a-a021-0c0949e47a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e6e3db-bf47-406a-a021-0c0949e47a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa419a2b-5093-4e19-b3d5-913b520b5c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa419a2b-5093-4e19-b3d5-913b520b5c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd629b3ba-a008-4f44-bbf4-3cdd4f1691ac', 'volume_name': 'volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342f4086-6da0-4231-ad0d-04ed2e012fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342f4086-6da0-4231-ad0d-04ed2e012fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dcc1d3-d1b9-4bbe-ac35-b8d25ca8004a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Volume d629b3ba-a008-4f44-bbf4-3cdd4f1691ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac', 'volume_size': 1} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317688418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d629b3ba-a008-4f44-bbf4-3cdd4f1691ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5242fda45dc641b0aa9f2589ffd92cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:47Z,use_quota=True,user_id='4edebbcf29884a51b4df216c804cfe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Creating volume d629b3ba-a008-4f44-bbf4-3cdd4f1691ac {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:46 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:46 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac 1073741824 Sep 30 22:27:46 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:47 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac 1073741824" returned: 0 in 0.567s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:47 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac Sep 30 22:27:47 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Flow 'volume_create_manager' (caea75e9-bb4b-4f36-81fe-1b5ed7de191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673e96ca-8531-40d0-89bb-fd46082f451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673e96ca-8531-40d0-89bb-fd46082f451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-319521532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19f4214-8bff-4121-9b4d-7e70eaa6bc8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403d450e31dc41b7847f9f68b520982d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:47Z,use_quota=True,user_id='96a59ae7643a4329a23d9c2ff8331963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af53d3b-7190-46ca-8e4e-54e981d41b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af53d3b-7190-46ca-8e4e-54e981d41b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9a10bb-7ebb-4a86-ade4-a89d0ad1a17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9a10bb-7ebb-4a86-ade4-a89d0ad1a17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19f4214-8bff-4121-9b4d-7e70eaa6bc8d', 'volume_name': 'volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9231c423-118e-44d4-9dd7-fa1287b931d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9231c423-118e-44d4-9dd7-fa1287b931d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0640b94-6db6-4892-944c-34a40168a450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Volume c19f4214-8bff-4121-9b4d-7e70eaa6bc8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d', 'volume_size': 1} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:47 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac" returned: 0 in 0.296s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.163s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-319521532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19f4214-8bff-4121-9b4d-7e70eaa6bc8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='403d450e31dc41b7847f9f68b520982d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:47Z,use_quota=True,user_id='96a59ae7643a4329a23d9c2ff8331963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Creating volume c19f4214-8bff-4121-9b4d-7e70eaa6bc8d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:47 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:47 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d 1073741824 Sep 30 22:27:47 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dcc1d3-d1b9-4bbe-ac35-b8d25ca8004a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe09d66b-ec69-439c-9ec2-fd59306e14bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Volume volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac (d629b3ba-a008-4f44-bbf4-3cdd4f1691ac): created successfully Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe09d66b-ec69-439c-9ec2-fd59306e14bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Flow 'volume_create_manager' (2da397c6-1642-4438-b066-4ffd6d9209f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ef0c14dd-20bc-48d8-957f-914f2d338b48 tempest-ProjectReaderTests-806713675 None] Created volume successfully. Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (0c75225a-f03f-4dfd-9721-c595c5682d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ec0f83-4c35-492d-9309-780e5741e1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ec0f83-4c35-492d-9309-780e5741e1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465068435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc051139-2e68-4192-a914-fda166796738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:48Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f465bf25-87aa-4c0f-949a-ec60f370466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f465bf25-87aa-4c0f-949a-ec60f370466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d368947c-ba26-43f1-a5ea-2218cb7300df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d368947c-ba26-43f1-a5ea-2218cb7300df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc051139-2e68-4192-a914-fda166796738', 'volume_name': 'volume-dc051139-2e68-4192-a914-fda166796738', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b744118-03ff-422a-8004-e93ef1f6cfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b744118-03ff-422a-8004-e93ef1f6cfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7cff9e-a164-4da0-b8f7-1c765cc71c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume dc051139-2e68-4192-a914-fda166796738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc051139-2e68-4192-a914-fda166796738', 'volume_size': 1} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:48 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d 1073741824" returned: 0 in 0.698s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (c2279ce1-6fae-45dc-b3c1-11295f5996c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da6ca7e-3073-421c-a623-4f562189e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da6ca7e-3073-421c-a623-4f562189e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20569378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c21b3bf-6595-46f8-b1a9-a56b01575893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:48Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:48 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d Sep 30 22:27:48 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fbc68e1-9aec-412a-a24a-1eaf9f327edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fbc68e1-9aec-412a-a24a-1eaf9f327edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442a0879-d617-4721-a13c-2775b7c5d723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442a0879-d617-4721-a13c-2775b7c5d723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c21b3bf-6595-46f8-b1a9-a56b01575893', 'volume_name': 'volume-2c21b3bf-6595-46f8-b1a9-a56b01575893', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6c52b1-63a1-4c86-af7a-4b676ae879ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6c52b1-63a1-4c86-af7a-4b676ae879ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba45669a-a44e-4a92-9e24-cf2713d74770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume 2c21b3bf-6595-46f8-b1a9-a56b01575893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c21b3bf-6595-46f8-b1a9-a56b01575893', 'volume_size': 1} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:48 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" returned: 0 in 0.414s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465068435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc051139-2e68-4192-a914-fda166796738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:48Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Creating volume dc051139-2e68-4192-a914-fda166796738 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:48 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:48 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738 1073741824 Sep 30 22:27:48 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0640b94-6db6-4892-944c-34a40168a450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0d77c1-dd41-456f-8078-6513f83e73d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Acquiring lock "cinder-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (1452ef0a-39a6-4eb3-8fd7-b525eaf46f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da21d15a-ebbf-4a46-a808-4d35d26c5f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Volume volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d (c19f4214-8bff-4121-9b4d-7e70eaa6bc8d): created successfully Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0d77c1-dd41-456f-8078-6513f83e73d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Flow 'volume_create_manager' (caea75e9-bb4b-4f36-81fe-1b5ed7de191c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Lock "cinder-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da21d15a-ebbf-4a46-a808-4d35d26c5f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874955937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b753510-ef10-4215-87f9-614c75314762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:49Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114d02f1-c1da-4635-b3dd-953a8665d991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114d02f1-c1da-4635-b3dd-953a8665d991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd082fff-3b82-4cff-b793-761bfdf19ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd082fff-3b82-4cff-b793-761bfdf19ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b753510-ef10-4215-87f9-614c75314762', 'volume_name': 'volume-8b753510-ef10-4215-87f9-614c75314762', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed179fb-2d47-43ea-8329-e534933effad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed179fb-2d47-43ea-8329-e534933effad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee254dd3-bfa6-4b1d-93d6-6f72a7667a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume 8b753510-ef10-4215-87f9-614c75314762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b753510-ef10-4215-87f9-614c75314762', 'volume_size': 1} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-80b42605-a279-4c45-a572-a050d9d1781b req-5dd5fc56-9acb-410e-93f0-0fa47775a950 tempest-VolumesSnapshotsTestJSON-1380627686 None] Created volume successfully. Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Acquiring lock "cinder-quobyte-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Lock "cinder-quobyte-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[409a6f57-4be6-4ba3-835d-c9b1b3fb4431]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (1d8f90ff-3119-4de1-b9b3-a914ea2258ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80b21cd-6dcb-4020-9986-6325e4609023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80b21cd-6dcb-4020-9986-6325e4609023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1504323481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd67f5e-ed68-4372-9c8e-ffd22890d13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:49Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de4c0ac-040c-4647-a00f-f371b88db511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de4c0ac-040c-4647-a00f-f371b88db511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755ffb72-ceac-4334-8a70-39bfdb647484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755ffb72-ceac-4334-8a70-39bfdb647484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd67f5e-ed68-4372-9c8e-ffd22890d13f', 'volume_name': 'volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9335a71-09bb-430e-ab15-45d0804b126b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac Sep 30 22:27:49 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9335a71-09bb-430e-ab15-45d0804b126b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9aece-b236-4b21-9b02-f7b1167348b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume 0cd67f5e-ed68-4372-9c8e-ffd22890d13f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f', 'volume_size': 1} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:49 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738 1073741824" returned: 0 in 0.812s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:49 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738 Sep 30 22:27:49 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (d72732ea-88eb-470b-968e-0d0fc20a9069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77140956-08bb-4090-92f1-d082d4bd0d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77140956-08bb-4090-92f1-d082d4bd0d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809831431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25401f07-34ec-4fe5-9049-c659d1240125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:50Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:50 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecf6147-f5f4-4cee-a049-6491bf39d73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecf6147-f5f4-4cee-a049-6491bf39d73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3fff38-a279-4c9f-94fd-69c778c024bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3fff38-a279-4c9f-94fd-69c778c024bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25401f07-34ec-4fe5-9049-c659d1240125', 'volume_name': 'volume-25401f07-34ec-4fe5-9049-c659d1240125', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda18a34-e017-4a93-b525-5a6cb8a990cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda18a34-e017-4a93-b525-5a6cb8a990cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d3ab40-5d23-4f8a-a4d4-112a1ca3d565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume 25401f07-34ec-4fe5-9049-c659d1240125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25401f07-34ec-4fe5-9049-c659d1240125', 'volume_size': 1} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac" returned: 0 in 0.703s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:50 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac Sep 30 22:27:50 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:50 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.614s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20569378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c21b3bf-6595-46f8-b1a9-a56b01575893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:48Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Creating volume 2c21b3bf-6595-46f8-b1a9-a56b01575893 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:50 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7cff9e-a164-4da0-b8f7-1c765cc71c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc051139-2e68-4192-a914-fda166796738', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880a4109-11b1-455d-a99d-eaa74071ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:50 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 1073741824 Sep 30 22:27:50 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume volume-dc051139-2e68-4192-a914-fda166796738 (dc051139-2e68-4192-a914-fda166796738): created successfully Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880a4109-11b1-455d-a99d-eaa74071ce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (0c75225a-f03f-4dfd-9721-c595c5682d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8f34a667-6b12-474c-abe3-3b50c6025e39 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created volume successfully. Sep 30 22:27:50 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac" returned: 0 in 0.308s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Lock "cinder-quobyte-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac" released by "delete_volume" :: held 1.070s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Created reservations ['25a87e23-6287-48d6-b3d2-f33fdb828fb4', '56c4b6a9-586e-468e-af30-a2d23d61e52d', 'b110a7de-1e21-4943-b72e-99785e9d9786', '1b231585-6d01-472e-9d86-7a858a4ec952'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:50 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:50 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:50 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 1073741824" returned: 0 in 0.721s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:50 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:50 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:51 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 Sep 30 22:27:51 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Deleted volume successfully. Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2fddf6be-af0b-4096-962c-a53f77915738 tempest-ProjectReaderTests-806713675 None] Lock "cinder-d629b3ba-a008-4f44-bbf4-3cdd4f1691ac-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:51 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-874955937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b753510-ef10-4215-87f9-614c75314762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:49Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Creating volume 8b753510-ef10-4215-87f9-614c75314762 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:51 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba45669a-a44e-4a92-9e24-cf2713d74770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c21b3bf-6595-46f8-b1a9-a56b01575893', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bd40f3-30e3-4c64-9f3b-612b4661d866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:51 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762 1073741824 Sep 30 22:27:51 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 (2c21b3bf-6595-46f8-b1a9-a56b01575893): created successfully Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bd40f3-30e3-4c64-9f3b-612b4661d866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (c2279ce1-6fae-45dc-b3c1-11295f5996c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-35bad1a6-10fb-4d04-ab44-9cc04b6ba6c4 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created volume successfully. Sep 30 22:27:51 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762 1073741824" returned: 0 in 0.584s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Flow 'volume_create_manager' (cd97e61e-75d7-4cdc-bfb3-f90916f5bb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675975b9-2bd0-4b05-9b30-975e342ee8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:51 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762 Sep 30 22:27:51 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675975b9-2bd0-4b05-9b30-975e342ee8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774970168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547572bc-ceac-4207-a72a-f7665b3cbc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5242fda45dc641b0aa9f2589ffd92cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:52Z,use_quota=True,user_id='4edebbcf29884a51b4df216c804cfe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb339d63-7602-4040-9bce-acef4c024f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb339d63-7602-4040-9bce-acef4c024f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5893d8bd-d8b7-41cc-a876-3c8d7d136ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5893d8bd-d8b7-41cc-a876-3c8d7d136ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '547572bc-ceac-4207-a72a-f7665b3cbc5e', 'volume_name': 'volume-547572bc-ceac-4207-a72a-f7665b3cbc5e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663885d3-20da-4b1e-be95-dfa6ab812013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663885d3-20da-4b1e-be95-dfa6ab812013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a96175-e010-4e5b-89eb-afea6ba94de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Volume 547572bc-ceac-4207-a72a-f7665b3cbc5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-547572bc-ceac-4207-a72a-f7665b3cbc5e', 'volume_size': 1} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:52 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762" returned: 0 in 0.284s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.545s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1504323481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd67f5e-ed68-4372-9c8e-ffd22890d13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:49Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Creating volume 0cd67f5e-ed68-4372-9c8e-ffd22890d13f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:52 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee254dd3-bfa6-4b1d-93d6-6f72a7667a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b753510-ef10-4215-87f9-614c75314762', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e1fe5f-d474-4632-be9e-4a1e42ebedc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:52 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f 1073741824 Sep 30 22:27:52 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume volume-8b753510-ef10-4215-87f9-614c75314762 (8b753510-ef10-4215-87f9-614c75314762): created successfully Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e1fe5f-d474-4632-be9e-4a1e42ebedc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (1452ef0a-39a6-4eb3-8fd7-b525eaf46f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-443842f8-381e-4ef1-9da0-828fb7492174 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created volume successfully. Sep 30 22:27:52 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f 1073741824" returned: 0 in 0.455s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:52 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f Sep 30 22:27:52 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:52 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f" returned: 0 in 0.267s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.915s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-809831431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25401f07-34ec-4fe5-9049-c659d1240125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f245234b0004c1a84060ee7952421b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:50Z,use_quota=True,user_id='19c7b780625b4e69ac2b2362f84b9ae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Creating volume 25401f07-34ec-4fe5-9049-c659d1240125 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:53 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9aece-b236-4b21-9b02-f7b1167348b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89055bde-fff5-4046-99e9-852f3bcbe1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:53 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125 1073741824 Sep 30 22:27:53 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f (0cd67f5e-ed68-4372-9c8e-ffd22890d13f): created successfully Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89055bde-fff5-4046-99e9-852f3bcbe1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (1d8f90ff-3119-4de1-b9b3-a914ea2258ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-937e0473-8d6d-4117-a67f-0cee5fe96c23 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created volume successfully. Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Flow 'volume_create_manager' (4e07ac91-1894-455d-b3f9-ead2b4d9c92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da729272-8baa-456d-bc63-bd8c899fe289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da729272-8baa-456d-bc63-bd8c899fe289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1016416227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e5f386-7c75-45da-893a-6b8f11c307bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49df78e8a8a44304bb37e60bd89e8ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:53Z,use_quota=True,user_id='d0fb58c0582f45cfb87cfa182ce09664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1842dc-b2f3-4779-9583-405818f8ab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1842dc-b2f3-4779-9583-405818f8ab7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c4f7d5-7523-4fa7-8e0c-f4bab5e7b754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c4f7d5-7523-4fa7-8e0c-f4bab5e7b754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e5f386-7c75-45da-893a-6b8f11c307bb', 'volume_name': 'volume-86e5f386-7c75-45da-893a-6b8f11c307bb', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8db2b4-9db6-40c0-9017-1ce016ccf304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8db2b4-9db6-40c0-9017-1ce016ccf304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:53 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ee5bb4-d6cc-4cc4-8ff1-9e1bc1a1a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Volume 86e5f386-7c75-45da-893a-6b8f11c307bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e5f386-7c75-45da-893a-6b8f11c307bb', 'volume_size': 1} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125 1073741824" returned: 0 in 0.539s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:53 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125 Sep 30 22:27:53 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:53 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.653s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Creating offline snapshot b269533d-dcd9-460f-852e-2ed5e064b1d5 of volume c19f4214-8bff-4121-9b4d-7e70eaa6bc8d {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d3ab40-5d23-4f8a-a4d4-112a1ca3d565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25401f07-34ec-4fe5-9049-c659d1240125', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8efe7e3-e8b3-43ec-8f1e-850b250a7102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aa74ba-387c-41b2-8e68-a7730beb7359]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Volume volume-25401f07-34ec-4fe5-9049-c659d1240125 (25401f07-34ec-4fe5-9049-c659d1240125): created successfully Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8efe7e3-e8b3-43ec-8f1e-850b250a7102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Flow 'volume_create_manager' (d72732ea-88eb-470b-968e-0d0fc20a9069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8602da86-ad20-4f74-a7dd-e20c5ab652d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created volume successfully. Sep 30 22:27:53 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d Sep 30 22:27:53 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:54 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" returned: 0 in 0.365s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:54 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 1G Sep 30 22:27:54 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-25401f07-34ec-4fe5-9049-c659d1240125-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-25401f07-34ec-4fe5-9049-c659d1240125-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-quobyte-25401f07-34ec-4fe5-9049-c659d1240125" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-25401f07-34ec-4fe5-9049-c659d1240125" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c932574-05d1-4cf6-927c-ef804f572319]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:54 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125 Sep 30 22:27:54 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:54 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 1G" returned: 0 in 0.434s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:54 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 Sep 30 22:27:54 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:54 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125" returned: 0 in 0.390s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:54 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125 Sep 30 22:27:54 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:55 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5" returned: 0 in 0.322s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:55 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 is being set with open permissions: ugo+rw Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:55 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 Sep 30 22:27:55 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:55 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25401f07-34ec-4fe5-9049-c659d1240125" returned: 0 in 0.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-25401f07-34ec-4fe5-9049-c659d1240125" released by "delete_volume" :: held 0.698s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:55 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5" returned: 0 in 0.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created reservations ['f15f1c22-b003-4432-80aa-daecbda969fb', '87093090-fe7b-4c0b-b02e-d07e10538696', '443f232e-4d66-4fd9-9fe0-b3bcc0e32d1e', 'b4c1f30f-f154-469c-946b-e078f6032fb9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:55 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.info Sep 30 22:27:55 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:55 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:55 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:55 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.info" returned: 0 in 0.278s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:55 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.info is being set with open permissions: ugo+rw Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:55 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.info Sep 30 22:27:55 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-0cd67f5e-ed68-4372-9c8e-ffd22890d13f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:55 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.269s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Deleted volume successfully. Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-0cd67f5e-ed68-4372-9c8e-ffd22890d13f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-181a7f17-7f73-43c1-83fb-791e4afd5f07 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-25401f07-34ec-4fe5-9049-c659d1240125-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-quobyte-0cd67f5e-ed68-4372-9c8e-ffd22890d13f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-0cd67f5e-ed68-4372-9c8e-ffd22890d13f" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d349252-49c2-4273-af64-9c47c186313e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:55 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f Sep 30 22:27:55 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:55 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.info" returned: 0 in 0.282s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.862s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774970168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=547572bc-ceac-4207-a72a-f7665b3cbc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5242fda45dc641b0aa9f2589ffd92cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:52Z,use_quota=True,user_id='4edebbcf29884a51b4df216c804cfe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Creating volume 547572bc-ceac-4207-a72a-f7665b3cbc5e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:55 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:55 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e 1073741824 Sep 30 22:27:55 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-a443dff1-6740-4752-9b2b-9f8783125e1c req-c2d4ce94-c15e-475f-97ff-a1464fda410d tempest-VolumesSnapshotsTestJSON-1380627686 None] Create snapshot completed successfully Sep 30 22:27:56 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f" returned: 0 in 0.395s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:56 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f Sep 30 22:27:56 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Acquiring lock "cinder-b269533d-dcd9-460f-852e-2ed5e064b1d5-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-b269533d-dcd9-460f-852e-2ed5e064b1d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Acquiring lock "cinder-quobyte-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-quobyte-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Acquiring lock "cinder-quobyte-b269533d-dcd9-460f-852e-2ed5e064b1d5" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-quobyte-b269533d-dcd9-460f-852e-2ed5e064b1d5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Deleting offline snapshot b269533d-dcd9-460f-852e-2ed5e064b1d5 of volume c19f4214-8bff-4121-9b4d-7e70eaa6bc8d {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] snapshot_file for this snap is: volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[af634d20-e268-4921-8fa2-b5aa6fb97d72]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:56 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e 1073741824" returned: 0 in 0.530s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:56 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-0cd67f5e-ed68-4372-9c8e-ffd22890d13f" returned: 0 in 0.338s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-0cd67f5e-ed68-4372-9c8e-ffd22890d13f" released by "delete_volume" :: held 0.783s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:56 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 Sep 30 22:27:56 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:56 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e Sep 30 22:27:56 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created reservations ['bcf07acb-f17f-474c-88dd-a48bd949becc', 'ef897fc3-abe2-4be6-b5d6-031e21f1bd81', '4e584409-5b9a-4a6b-bcd6-a9fd5c07123d', '86e842eb-cb1e-4af0-8204-2ca2092e40aa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:56 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:56 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:56 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e" returned: 0 in 0.292s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.247s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1016416227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e5f386-7c75-45da-893a-6b8f11c307bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49df78e8a8a44304bb37e60bd89e8ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:53Z,use_quota=True,user_id='d0fb58c0582f45cfb87cfa182ce09664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Creating volume 86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:56 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:56 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-8b753510-ef10-4215-87f9-614c75314762-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5" returned: 0 in 0.453s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:27:56 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb 1073741824 Sep 30 22:27:56 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a96175-e010-4e5b-89eb-afea6ba94de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-547572bc-ceac-4207-a72a-f7665b3cbc5e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2e2313-d781-498b-8e4b-b6e292bdaa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-8b753510-ef10-4215-87f9-614c75314762-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f9036a-ffec-4118-99bf-2f0f2a6c120a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Volume volume-547572bc-ceac-4207-a72a-f7665b3cbc5e (547572bc-ceac-4207-a72a-f7665b3cbc5e): created successfully Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2e2313-d781-498b-8e4b-b6e292bdaa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Flow 'volume_create_manager' (cd97e61e-75d7-4cdc-bfb3-f90916f5bb4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:56 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-68c29fb0-e6ee-4624-bb9b-e4e56b25dcff tempest-ProjectReaderTests-806713675 None] Created volume successfully. Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.326s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-quobyte-8b753510-ef10-4215-87f9-614c75314762" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Deleted volume successfully. Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-8b753510-ef10-4215-87f9-614c75314762" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7043c103-e255-424d-8051-71a7448b6016 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-0cd67f5e-ed68-4372-9c8e-ffd22890d13f-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9618cb06-12a1-4ece-8aa2-2ad55c77d8e0]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:57 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d Sep 30 22:27:57 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Acquiring lock "cinder-547572bc-ceac-4207-a72a-f7665b3cbc5e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:57 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762 Sep 30 22:27:57 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Lock "cinder-547572bc-ceac-4207-a72a-f7665b3cbc5e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Acquiring lock "cinder-quobyte-547572bc-ceac-4207-a72a-f7665b3cbc5e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Lock "cinder-quobyte-547572bc-ceac-4207-a72a-f7665b3cbc5e" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76f0c8b-7ace-4894-81ab-05b1eecd415a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:57 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" returned: 0 in 0.471s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:57 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 Sep 30 22:27:57 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:57 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb 1073741824" returned: 0 in 0.649s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:57 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e Sep 30 22:27:57 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:57 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762" returned: 0 in 0.476s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:57 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb Sep 30 22:27:57 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:57 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762 Sep 30 22:27:57 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:57 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5" returned: 0 in 0.404s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:57 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e" returned: 0 in 0.463s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:57 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5 Sep 30 22:27:57 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:57 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:57 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e Sep 30 22:27:57 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:57 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b753510-ef10-4215-87f9-614c75314762" returned: 0 in 0.327s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-8b753510-ef10-4215-87f9-614c75314762" released by "delete_volume" :: held 0.862s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ee5bb4-d6cc-4cc4-8ff1-9e1bc1a1a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e5f386-7c75-45da-893a-6b8f11c307bb', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c783164-ff24-4823-b889-56542b0779e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Volume volume-86e5f386-7c75-45da-893a-6b8f11c307bb (86e5f386-7c75-45da-893a-6b8f11c307bb): created successfully Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c783164-ff24-4823-b889-56542b0779e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Flow 'volume_create_manager' (4e07ac91-1894-455d-b3f9-ead2b4d9c92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0e24d032-9b56-49e6-9f9d-7ccdb32b4313 tempest-VolumesCloneTest-2110485144 None] Created volume successfully. Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created reservations ['57f54587-71e0-4213-a1b5-3181cbb9be49', 'dc7820f8-47e0-4798-9009-e06a8c323cfd', '2104d279-fb32-4134-bcff-4d3f8b0876bd', '18ba1eda-0b1d-489c-bd8b-dea125f79081'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:58 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d.b269533d-dcd9-460f-852e-2ed5e064b1d5" returned: 0 in 0.292s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:58 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:58 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-quobyte-b269533d-dcd9-460f-852e-2ed5e064b1d5" released by "_delete_snapshot" :: held 1.788s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-quobyte-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" released by "delete_snapshot" :: held 1.815s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:58 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-547572bc-ceac-4207-a72a-f7665b3cbc5e" returned: 0 in 0.341s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Lock "cinder-quobyte-547572bc-ceac-4207-a72a-f7665b3cbc5e" released by "delete_volume" :: held 0.857s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.quota [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Created reservations ['754d4b2a-051a-4272-b348-62799ae7aa95', 'b7f943f0-bb84-4a8a-9088-b08f974c96e3', 'd918d9dc-5715-469f-97aa-e9cc2b2bc389', 'c4a05f42-acdf-4549-a3a3-dfaec6fdfdd2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Created reservations ['26e77336-a5c3-47f1-ba60-fabede48d0e0', 'eafa803a-a9bc-4334-8ab3-33e547f40be6', 'b3e7d0a8-eadd-47cd-839d-0e3c5405fd98', 'ab8db64b-4d5f-4374-be8f-87f75dd8e7fa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Delete snapshot completed successfully. Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-86d941fc-fdd0-491d-8a5b-5bc71a733754 req-1d48150d-90b9-4f43-9a60-e0554c368c9b tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-b269533d-dcd9-460f-852e-2ed5e064b1d5-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:58 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.297s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Deleted volume successfully. Sep 30 22:27:58 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:58 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-359ee158-dfc3-47b1-91a4-716d70fd3d56 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-8b753510-ef10-4215-87f9-614c75314762-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Acquiring lock "cinder-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:58 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.313s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:27:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Deleted volume successfully. Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Acquiring lock "cinder-quobyte-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a257d732-30d7-43eb-9e7b-e8bd6741cb4f tempest-ProjectReaderTests-806713675 None] Lock "cinder-547572bc-ceac-4207-a72a-f7665b3cbc5e-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-quobyte-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" acquired by "delete_volume" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3865923-0a83-4678-abbd-70e41a7a206b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:58 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d Sep 30 22:27:58 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:58 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Flow 'volume_create_manager' (d9d8085b-362a-45cd-9545-21a7b6a92dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0257c7-be7f-4084-ac23-abe314112f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0257c7-be7f-4084-ac23-abe314112f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667668377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11608ff3-bde9-4706-83f1-186baed0b5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5242fda45dc641b0aa9f2589ffd92cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:59Z,use_quota=True,user_id='4edebbcf29884a51b4df216c804cfe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6e6573-6ba6-4896-b766-b027524b4129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6e6573-6ba6-4896-b766-b027524b4129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a1c182-77e3-4788-9d17-35d4d5c8778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a1c182-77e3-4788-9d17-35d4d5c8778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11608ff3-bde9-4706-83f1-186baed0b5f4', 'volume_name': 'volume-11608ff3-bde9-4706-83f1-186baed0b5f4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1913eb-f550-426f-a1c4-ddc68c8e4b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1913eb-f550-426f-a1c4-ddc68c8e4b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18a906c-d3a7-42b4-8702-dfc7ef9feed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Volume 11608ff3-bde9-4706-83f1-186baed0b5f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11608ff3-bde9-4706-83f1-186baed0b5f4', 'volume_size': 1} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667668377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11608ff3-bde9-4706-83f1-186baed0b5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5242fda45dc641b0aa9f2589ffd92cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:59Z,use_quota=True,user_id='4edebbcf29884a51b4df216c804cfe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Creating volume 11608ff3-bde9-4706-83f1-186baed0b5f4 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:27:59 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-2c21b3bf-6595-46f8-b1a9-a56b01575893-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:59 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4 1073741824 Sep 30 22:27:59 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-2c21b3bf-6595-46f8-b1a9-a56b01575893-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-quobyte-2c21b3bf-6595-46f8-b1a9-a56b01575893" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-2c21b3bf-6595-46f8-b1a9-a56b01575893" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:27:59 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" returned: 0 in 0.472s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e258f46-6ca1-4541-97f0-40b80a021161]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:59 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d Sep 30 22:27:59 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:59 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 Sep 30 22:27:59 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Flow 'volume_create_manager' (4fa40a76-f75c-4569-8336-cee72ce70af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0854b019-ef20-4728-804e-b4d07a655bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0854b019-ef20-4728-804e-b4d07a655bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-471700395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda680e9-387b-4ee2-8028-2d60a3183330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49df78e8a8a44304bb37e60bd89e8ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:27:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=86e5f386-7c75-45da-893a-6b8f11c307bb,status='creating',terminated_at=None,updated_at=2026-09-30T20:27:59Z,use_quota=True,user_id='d0fb58c0582f45cfb87cfa182ce09664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b2c435-850e-47d1-bb89-f6192982e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b2c435-850e-47d1-bb89-f6192982e956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff67ef69-fd9b-45f7-9600-0feb7d383494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" returned: 0 in 0.329s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff67ef69-fd9b-45f7-9600-0feb7d383494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dda680e9-387b-4ee2-8028-2d60a3183330', 'volume_name': 'volume-dda680e9-387b-4ee2-8028-2d60a3183330', 'volume_size': 2, 'source_volid': '86e5f386-7c75-45da-893a-6b8f11c307bb', 'source_volstatus': 'available'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:59 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62304e26-152d-4283-aca8-16c256bb63ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62304e26-152d-4283-aca8-16c256bb63ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e19748-bce0-4108-850b-ecadd7372213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:27:59 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Volume dda680e9-387b-4ee2-8028-2d60a3183330: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dda680e9-387b-4ee2-8028-2d60a3183330', 'volume_size': 2, 'source_volid': '86e5f386-7c75-45da-893a-6b8f11c307bb', 'source_volstatus': 'available'} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-quobyte-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d" released by "delete_volume" :: held 0.948s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4 1073741824" returned: 0 in 0.584s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:59 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893" returned: 0 in 0.408s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:59 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893 Sep 30 22:27:59 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.quota [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Created reservations ['7635cb5a-d6dc-4f43-a892-9d4b3152256e', '03247267-01bd-400d-a5b8-96bbb2889ba9', 'd11e8e4a-dfc1-4180-a2c3-830cefe446b3', '3aba1782-5825-45b5-a622-76a2cdcb6292'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:27:59 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4 Sep 30 22:27:59 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:27:59 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:27:59 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:00 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:00 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4" returned: 0 in 0.286s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-2c21b3bf-6595-46f8-b1a9-a56b01575893" returned: 0 in 0.308s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.355s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:00 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Cloning volume 86e5f386-7c75-45da-893a-6b8f11c307bb to volume dda680e9-387b-4ee2-8028-2d60a3183330 Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-2c21b3bf-6595-46f8-b1a9-a56b01575893" released by "delete_volume" :: held 0.822s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18a906c-d3a7-42b4-8702-dfc7ef9feed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11608ff3-bde9-4706-83f1-186baed0b5f4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90123e59-c187-41b0-ad9c-146dc381ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:00 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Volume volume-11608ff3-bde9-4706-83f1-186baed0b5f4 (11608ff3-bde9-4706-83f1-186baed0b5f4): created successfully Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90123e59-c187-41b0-ad9c-146dc381ce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Flow 'volume_create_manager' (d9d8085b-362a-45cd-9545-21a7b6a92dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Creating offline snapshot 6ac808ec-fab4-4e18-8934-b923e98a2bf8 of volume 86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:28:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f878beb8-3e4c-49fb-9d9f-601ba5b75356 tempest-ProjectReaderTests-806713675 None] Created volume successfully. Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee24ea-e4fa-481e-8436-ae71d204f991]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created reservations ['f91c2a52-5faf-4fc2-a4e4-124cc839ac0d', '67f11608-3f8f-4d23-adc1-41429d8bc3a4', 'fe86cff0-88c1-46ac-9685-6661522bb26f', '77c0fec9-a14c-47de-b24f-47587f9f1a2a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:00 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.371s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.manager [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Deleted volume successfully. Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-fad80ac6-59c4-461f-8c79-4372baea8c12 req-13b78e13-0008-45f1-b2b0-7709a89d1896 tempest-VolumesSnapshotsTestJSON-1380627686 None] Lock "cinder-c19f4214-8bff-4121-9b4d-7e70eaa6bc8d-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:00 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb Sep 30 22:28:00 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:00 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:00 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:00 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Deleted volume successfully. Sep 30 22:28:00 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-66600395-514e-48f9-96b0-329f60ec96d9 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-2c21b3bf-6595-46f8-b1a9-a56b01575893-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb" returned: 0 in 0.468s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:00 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 1G Sep 30 22:28:00 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:01 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 1G" returned: 0 in 0.446s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86e5f386-7c75-45da-893a-6b8f11c307bb -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:01 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86e5f386-7c75-45da-893a-6b8f11c307bb -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 Sep 30 22:28:01 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Acquiring lock "cinder-11608ff3-bde9-4706-83f1-186baed0b5f4-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Lock "cinder-11608ff3-bde9-4706-83f1-186baed0b5f4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Acquiring lock "cinder-quobyte-11608ff3-bde9-4706-83f1-186baed0b5f4" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Lock "cinder-quobyte-11608ff3-bde9-4706-83f1-186baed0b5f4" acquired by "delete_volume" :: waited 0.040s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44bd70b-0d6b-487c-ac26-3a50cb29ec53]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-dc051139-2e68-4192-a914-fda166796738-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-dc051139-2e68-4192-a914-fda166796738-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:01 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4 Sep 30 22:28:01 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:01 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86e5f386-7c75-45da-893a-6b8f11c307bb -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8" returned: 0 in 0.464s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:01 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 is being set with open permissions: ugo+rw Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:01 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 Sep 30 22:28:01 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-quobyte-dc051139-2e68-4192-a914-fda166796738" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-dc051139-2e68-4192-a914-fda166796738" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fb2c71-f7a3-41f1-8f9e-b24e8827740c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:01 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738 Sep 30 22:28:01 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:01 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8" returned: 0 in 0.315s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:01 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4" returned: 0 in 0.532s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:01 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4 Sep 30 22:28:01 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:01 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.info Sep 30 22:28:01 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:02 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738" returned: 0 in 0.466s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:02 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738 Sep 30 22:28:02 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:02 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-11608ff3-bde9-4706-83f1-186baed0b5f4" returned: 0 in 0.337s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:02 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.info" returned: 0 in 0.318s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:02 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.info is being set with open permissions: ugo+rw Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Lock "cinder-quobyte-11608ff3-bde9-4706-83f1-186baed0b5f4" released by "delete_volume" :: held 0.983s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:02 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.info Sep 30 22:28:02 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Created reservations ['9418bac6-ee4a-47a5-a823-f48d1afef907', '1525e5d6-02a4-419d-ba33-8f41d0265195', 'ec2e0655-dc43-49eb-8617-9ab8311900dd', '47c02372-4887-4183-8c89-81219e966b0f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:02 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc051139-2e68-4192-a914-fda166796738" returned: 0 in 0.299s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:02 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:02 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-dc051139-2e68-4192-a914-fda166796738" released by "delete_volume" :: held 0.825s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created reservations ['e74caeb7-be74-44c5-ad72-265cfe7d5458', '65f2c823-7267-485f-ae34-bced84260603', 'a5d65a6f-4fb3-46d2-8324-302f5c3a0716', '0d5b9f5e-2224-4b71-9ce4-3667a67b0de4'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:02 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.info" returned: 0 in 0.302s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Acquiring lock "cinder-quobyte-dda680e9-387b-4ee2-8028-2d60a3183330" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Lock "cinder-quobyte-dda680e9-387b-4ee2-8028-2d60a3183330" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] snapshot: 6ac808ec-fab4-4e18-8934-b923e98a2bf8, volume: dda680e9-387b-4ee2-8028-2d60a3183330, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[570f0ba5-b5ad-4494-ab70-95a2daecf687]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:02 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-ac382eec-d0fb-4207-a169-4e486bb6d55c-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.351s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:02 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:02 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Deleted volume successfully. Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-ac382eec-d0fb-4207-a169-4e486bb6d55c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-quobyte-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:02 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 Sep 30 22:28:02 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-quobyte-ac382eec-d0fb-4207-a169-4e486bb6d55c" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1e12576-8512-4461-b31f-da7480b5399f tempest-ProjectReaderTests-806713675 None] Lock "cinder-11608ff3-bde9-4706-83f1-186baed0b5f4-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-ac382eec-d0fb-4207-a169-4e486bb6d55c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Deleting offline snapshot ac382eec-d0fb-4207-a169-4e486bb6d55c of volume 6cd09b83-a2ef-44fa-8a11-98625d98f0c9 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] snapshot_file for this snap is: volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa48dda5-6183-4999-855a-75b9cd333a92]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:03 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c Sep 30 22:28:03 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:03 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.364s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Deleted volume successfully. Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-92499f78-ff57-4892-90a3-ee0e537f9d91 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-dc051139-2e68-4192-a914-fda166796738-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:03 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8" returned: 0 in 0.487s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86e5f386-7c75-45da-893a-6b8f11c307bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:28:03 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:03 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[671423f4-d366-4379-8ab9-6b676a1d99a2]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:03 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb Sep 30 22:28:03 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:03 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c" returned: 0 in 0.459s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e040d47a-0140-436e-8016-f558ae6c52d7]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:03 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.311s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:28:03 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 Sep 30 22:28:03 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:03 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb" returned: 0 in 0.521s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:03 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 Sep 30 22:28:03 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:03 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" returned: 0 in 0.517s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:03 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c Sep 30 22:28:03 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Flow 'volume_create_manager' (9e2905a9-88fc-45f9-8476-228f11fbaba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0a7430-9fec-4d74-972a-a90fbf7dc950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e0a7430-9fec-4d74-972a-a90fbf7dc950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2054055896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44f8f09-1907-42a6-9e86-1a6a82d852f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5242fda45dc641b0aa9f2589ffd92cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:04Z,use_quota=True,user_id='4edebbcf29884a51b4df216c804cfe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65538484-2d9e-42a3-8aba-660411dd1b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65538484-2d9e-42a3-8aba-660411dd1b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbff5256-6721-4a93-9401-840dbcdd4113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbff5256-6721-4a93-9401-840dbcdd4113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44f8f09-1907-42a6-9e86-1a6a82d852f7', 'volume_name': 'volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8ee9d0-ec93-46c2-9a72-7701522d0d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8ee9d0-ec93-46c2-9a72-7701522d0d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50bc3c8-8597-4c91-9e62-d680c89c32c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Volume c44f8f09-1907-42a6-9e86-1a6a82d852f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7', 'volume_size': 1} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:04 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c" returned: 0 in 0.401s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:04 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c Sep 30 22:28:04 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:04 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9.ac382eec-d0fb-4207-a169-4e486bb6d55c" returned: 0 in 0.556s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-ac382eec-d0fb-4207-a169-4e486bb6d55c" released by "_delete_snapshot" :: held 2.195s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" released by "delete_snapshot" :: held 2.240s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:05 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created reservations ['33f153c4-9bd8-4bc4-a64c-575044de2794', 'dc207025-b7e7-4d7e-b686-26e6e9e6aeca', '7c61d4be-a3fc-497a-8e28-d72c587f4df2', '96ef8670-63c3-48b2-960f-ba01715cb806'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Delete snapshot completed successfully. Sep 30 22:28:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-645cb5fe-5c0b-4ae9-b68c-924e794af96a tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-ac382eec-d0fb-4207-a169-4e486bb6d55c-delete_snapshot" released by "delete_snapshot" :: held 2.483s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-6cd09b83-a2ef-44fa-8a11-98625d98f0c9-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-6cd09b83-a2ef-44fa-8a11-98625d98f0c9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "cinder-quobyte-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabf9b62-3941-41b5-85f2-46aedeebd038]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:06 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 Sep 30 22:28:06 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:06 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" returned: 0 in 0.636s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:07 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9 Sep 30 22:28:07 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:07 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" returned: 0 in 0.565s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-quobyte-6cd09b83-a2ef-44fa-8a11-98625d98f0c9" released by "delete_volume" :: held 1.377s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Created reservations ['70aa6f34-ef06-49b4-afea-f3560322ecd9', 'dbf9de67-ad84-4ab9-80f5-13cbf356b2f9', '03eb6b0c-445e-4c37-8e30-a876245310c4', '59e95c96-432b-42c2-86a6-5b80a434f6ab'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:08 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:08 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:08 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.538s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:08 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Deleted volume successfully. Sep 30 22:28:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8631701e-3422-4f67-a0d1-c3dd65d4a259 tempest-CreateVolumesFromSnapshotTest-1483524277 None] Lock "cinder-6cd09b83-a2ef-44fa-8a11-98625d98f0c9-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:12 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330" returned: 0 in 8.642s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb, size 1024.00 MB, duration 8.65 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:28:12 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Converted 1024.00 MB image at 118.43 MB/s Sep 30 22:28:12 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 is being set with open permissions: ugo+rw Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:12 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 Sep 30 22:28:12 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:12 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330" returned: 0 in 0.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Lock "cinder-quobyte-dda680e9-387b-4ee2-8028-2d60a3183330" released by "_copy_volume_from_snapshot" :: held 10.041s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Acquiring lock "cinder-quobyte-6ac808ec-fab4-4e18-8934-b923e98a2bf8" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Lock "cinder-quobyte-6ac808ec-fab4-4e18-8934-b923e98a2bf8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Deleting offline snapshot 6ac808ec-fab4-4e18-8934-b923e98a2bf8 of volume 86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] snapshot_file for this snap is: volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d756901-bb00-4c9d-bccd-feabae691fef]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:12 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 Sep 30 22:28:12 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:13 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8" returned: 0 in 0.401s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86e5f386-7c75-45da-893a-6b8f11c307bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:28:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd73d29-8212-49b1-9c75-b4d5dd177501]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:13 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb Sep 30 22:28:13 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:13 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb" returned: 0 in 0.618s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:13 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 Sep 30 22:28:13 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=122,cinder:UPDATE=197,cinder:INSERT=46,cinder:DELETE=19 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=153,cinder:UPDATE=165,cinder:INSERT=52,cinder:DELETE=11 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:28:14 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8" returned: 0 in 0.438s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:14 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8 Sep 30 22:28:14 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:14 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb.6ac808ec-fab4-4e18-8934-b923e98a2bf8" returned: 0 in 0.285s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Lock "cinder-quobyte-6ac808ec-fab4-4e18-8934-b923e98a2bf8" released by "_delete_snapshot" :: held 1.860s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.524s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.417s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2054055896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44f8f09-1907-42a6-9e86-1a6a82d852f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5242fda45dc641b0aa9f2589ffd92cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:04Z,use_quota=True,user_id='4edebbcf29884a51b4df216c804cfe7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Creating volume c44f8f09-1907-42a6-9e86-1a6a82d852f7 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:28:14 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e19748-bce0-4108-850b-ecadd7372213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda680e9-387b-4ee2-8028-2d60a3183330', 'volume_size': 2, 'source_volid': '86e5f386-7c75-45da-893a-6b8f11c307bb', 'source_volstatus': 'available'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:14 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 1073741824 Sep 30 22:28:14 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d9b847-2524-495d-8f2f-f3c7862bf1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:14 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Volume volume-dda680e9-387b-4ee2-8028-2d60a3183330 (dda680e9-387b-4ee2-8028-2d60a3183330): created successfully Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d9b847-2524-495d-8f2f-f3c7862bf1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Flow 'volume_create_manager' (4fa40a76-f75c-4569-8336-cee72ce70af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-749f1270-fde6-4a8f-af55-aa2e45d4706e tempest-VolumesCloneTest-2110485144 None] Created volume successfully. Sep 30 22:28:15 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 1073741824" returned: 0 in 0.613s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:15 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 Sep 30 22:28:15 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Acquiring lock "cinder-dda680e9-387b-4ee2-8028-2d60a3183330-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Lock "cinder-dda680e9-387b-4ee2-8028-2d60a3183330-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Acquiring lock "cinder-quobyte-dda680e9-387b-4ee2-8028-2d60a3183330" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Lock "cinder-quobyte-dda680e9-387b-4ee2-8028-2d60a3183330" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b6f03c-f97b-452f-9666-15b9d98eb374]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:15 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7" returned: 0 in 0.357s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50bc3c8-8597-4c91-9e62-d680c89c32c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a6b492-7347-42f2-9278-cc776b92a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Volume volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 (c44f8f09-1907-42a6-9e86-1a6a82d852f7): created successfully Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a6b492-7347-42f2-9278-cc776b92a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Flow 'volume_create_manager' (9e2905a9-88fc-45f9-8476-228f11fbaba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-46bddc5e-6425-4f32-9df9-5ea0c5d6a00b tempest-ProjectReaderTests-806713675 None] Created volume successfully. Sep 30 22:28:15 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 Sep 30 22:28:15 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:16 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330" returned: 0 in 0.443s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:16 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330 Sep 30 22:28:16 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:16 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dda680e9-387b-4ee2-8028-2d60a3183330" returned: 0 in 0.326s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Lock "cinder-quobyte-dda680e9-387b-4ee2-8028-2d60a3183330" released by "delete_volume" :: held 0.846s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Acquiring lock "cinder-c44f8f09-1907-42a6-9e86-1a6a82d852f7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Lock "cinder-c44f8f09-1907-42a6-9e86-1a6a82d852f7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-505b933d-e2e3-49aa-a414-bdcda5e85aa8 tempest-GroupsTest-946082828 None] Group tempest-Group1-19047925: creating Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Acquiring lock "cinder-quobyte-c44f8f09-1907-42a6-9e86-1a6a82d852f7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-505b933d-e2e3-49aa-a414-bdcda5e85aa8 tempest-GroupsTest-946082828 None] Group tempest-Group1-19047925: created successfully Sep 30 22:28:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-505b933d-e2e3-49aa-a414-bdcda5e85aa8 tempest-GroupsTest-946082828 None] Create group completed successfully. Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Created reservations ['c15663b3-0c9f-4b69-9f30-7bf34388f040', '9e8adcc2-4c7e-4094-85a5-bf06aa89fdd9', 'd9869c25-e4f1-4547-bfb1-6244e205ba76', '1658c977-1537-4fc9-9161-96ff5a34259a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Lock "cinder-quobyte-c44f8f09-1907-42a6-9e86-1a6a82d852f7" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d7139e-cf83-4ca4-8527-b5ae747db972]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:16 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 Sep 30 22:28:16 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:16 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:16 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:16 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7" returned: 0 in 0.408s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:17 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7 Sep 30 22:28:17 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:17 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.335s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Deleted volume successfully. Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dce2d23c-c3a8-4983-b22b-56bd6fb81465 tempest-VolumesCloneTest-2110485144 None] Lock "cinder-dda680e9-387b-4ee2-8028-2d60a3183330-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:17 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c44f8f09-1907-42a6-9e86-1a6a82d852f7" returned: 0 in 0.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Lock "cinder-quobyte-c44f8f09-1907-42a6-9e86-1a6a82d852f7" released by "delete_volume" :: held 0.749s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Created reservations ['b4497aa8-3c2e-495b-99db-18d54d1d563a', '746c8764-f473-4148-8ccb-fac6a295dc39', '0efe5811-d424-4537-a1ab-39e8a296b086', 'b2046aff-d54e-4df5-9331-dd9cd0839017'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:17 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:17 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:17 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.350s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Deleted volume successfully. Sep 30 22:28:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-16f22c1b-8168-4ebf-b16e-fe842f15cdbe tempest-GroupsTest-946082828 None] Group tempest-Group2-844521635: creating Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-35533c9f-deee-499c-84ed-04b810efdf25 tempest-ProjectReaderTests-806713675 None] Lock "cinder-c44f8f09-1907-42a6-9e86-1a6a82d852f7-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-16f22c1b-8168-4ebf-b16e-fe842f15cdbe tempest-GroupsTest-946082828 None] Group tempest-Group2-844521635: created successfully Sep 30 22:28:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-16f22c1b-8168-4ebf-b16e-fe842f15cdbe tempest-GroupsTest-946082828 None] Create group completed successfully. Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Acquiring lock "cinder-86e5f386-7c75-45da-893a-6b8f11c307bb-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Lock "cinder-86e5f386-7c75-45da-893a-6b8f11c307bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Acquiring lock "cinder-quobyte-86e5f386-7c75-45da-893a-6b8f11c307bb" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Lock "cinder-quobyte-86e5f386-7c75-45da-893a-6b8f11c307bb" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a434bdb-289c-4aef-8f24-64036f77de47]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:18 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb Sep 30 22:28:18 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:18 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb" returned: 0 in 0.389s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:18 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb Sep 30 22:28:18 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:18 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-86e5f386-7c75-45da-893a-6b8f11c307bb" returned: 0 in 0.267s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Lock "cinder-quobyte-86e5f386-7c75-45da-893a-6b8f11c307bb" released by "delete_volume" :: held 0.731s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Created reservations ['ad079888-776d-4aad-ac5f-281767e07a61', 'a1de0d1c-c7c4-4463-9688-dacc4dc778ab', '38d8c450-910f-475f-860f-f4746d0fec23', 'c80e8e19-bbf9-4a49-b112-228c8ebfb7d7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:18 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:18 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:19 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Deleted volume successfully. Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e655e2a-3eee-41c1-8068-9e1ff52aee23 tempest-VolumesCloneTest-2110485144 None] Lock "cinder-86e5f386-7c75-45da-893a-6b8f11c307bb-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Flow 'volume_create_manager' (02f10559-3fa4-4ce5-86ef-10c2e5a30da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f871e9-6696-4f49-847f-69e0e3003186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f871e9-6696-4f49-847f-69e0e3003186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-880021426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e612c323-0021-4ab1-b237-fe9a6d71c351,host='devstack@QuobyteHD#QuobyteHD',id=cc0f4595-5fe9-40b6-941d-f74d90deae9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605a925974a346aa87f6176e7a47f49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:19Z,use_quota=True,user_id='3a9ed221957146b0b803592086acf8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ee21ab6-5b5f-4eb0-8e14-59b053b9fb25),volume_type_id=7ee21ab6-5b5f-4eb0-8e14-59b053b9fb25)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c83d22-fc5d-4412-b849-fcae5aa2bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c83d22-fc5d-4412-b849-fcae5aa2bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aeb99df-de3f-4fde-abc4-03b7b9b2807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aeb99df-de3f-4fde-abc4-03b7b9b2807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0f4595-5fe9-40b6-941d-f74d90deae9a', 'volume_name': 'volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d57339b-8eac-41ae-b10a-711164d8f2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d57339b-8eac-41ae-b10a-711164d8f2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb63e38-4229-464a-bf25-c548e6913e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:19 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Volume cc0f4595-5fe9-40b6-941d-f74d90deae9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a', 'volume_size': 1} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e612c323-0021-4ab1-b237-fe9a6d71c351,created_at=2026-09-30T20:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-880021426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e612c323-0021-4ab1-b237-fe9a6d71c351,host='devstack@QuobyteHD#QuobyteHD',id=cc0f4595-5fe9-40b6-941d-f74d90deae9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605a925974a346aa87f6176e7a47f49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:19Z,use_quota=True,user_id='3a9ed221957146b0b803592086acf8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ee21ab6-5b5f-4eb0-8e14-59b053b9fb25),volume_type_id=7ee21ab6-5b5f-4eb0-8e14-59b053b9fb25)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Creating volume cc0f4595-5fe9-40b6-941d-f74d90deae9a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:28:19 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:28:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:19 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a 1073741824 Sep 30 22:28:19 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:20 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a 1073741824" returned: 0 in 0.472s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:20 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a Sep 30 22:28:20 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:20 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a" returned: 0 in 0.279s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:28:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb63e38-4229-464a-bf25-c548e6913e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628314f4-0764-47dc-850f-221d1ee1286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:20 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Volume volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a (cc0f4595-5fe9-40b6-941d-f74d90deae9a): created successfully Sep 30 22:28:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628314f4-0764-47dc-850f-221d1ee1286c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Flow 'volume_create_manager' (02f10559-3fa4-4ce5-86ef-10c2e5a30da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-869e0c9a-cd7a-4da3-8e2a-6fbec1cd9613 tempest-GroupsTest-946082828 None] Created volume successfully. Sep 30 22:28:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Acquiring lock "cinder-quobyte-cc0f4595-5fe9-40b6-941d-f74d90deae9a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Lock "cinder-quobyte-cc0f4595-5fe9-40b6-941d-f74d90deae9a" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29856b8-2b36-46e4-8535-b4e0ea5ffd98]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:21 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a Sep 30 22:28:21 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:21 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a" returned: 0 in 0.427s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:21 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a Sep 30 22:28:21 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:22 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-cc0f4595-5fe9-40b6-941d-f74d90deae9a" returned: 0 in 0.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Lock "cinder-quobyte-cc0f4595-5fe9-40b6-941d-f74d90deae9a" released by "delete_volume" :: held 0.752s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Created reservations ['6bc89f95-8f0e-46eb-9b4e-406f6f20cfa6'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:22 devstack cinder-volume[87240]: WARNING cinder.quota [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-45611249 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-45611249, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:28:22 devstack cinder-volume[87240]: WARNING cinder.quota [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-45611249 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-45611249, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Created reservations ['1e0689cd-dbaa-45ad-acce-9ed509c2aa12', 'df82e49a-2dca-43b9-81e1-f225fe10fc49', '245465fd-8810-43a4-a62f-1b9502efdef5', '6b57d995-56e6-4057-9541-9d800a3d610f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:22 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:22 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:22 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.253s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9c48a8bf-91b3-4c16-9afc-884e9b19e23d tempest-GroupsTest-946082828 None] Delete group completed successfully. Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] Created reservations ['5c7c47a4-bac2-4a42-8b18-2122879b1902'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:22 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:22 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:23 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b8e8405b-cb73-4652-ac7b-b07b1af74eec tempest-GroupsTest-946082828 None] Delete group completed successfully. Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Flow 'volume_create_manager' (7a131048-303f-490f-8c4b-699e985de50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7b62f5-3cdd-43f4-b4cf-4d0e66e8421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7b62f5-3cdd-43f4-b4cf-4d0e66e8421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-284008279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52025ce4-f2b7-49bb-a309-47c3d8658f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe3185541d34a18b8f7eabdbbe5798f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:24Z,use_quota=True,user_id='a10ebb774c6649a9bda967f4dce21db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bc2416-287c-4490-907a-c195bc010d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7bc2416-287c-4490-907a-c195bc010d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11738414-562c-41b4-ba57-b8aa7e54da1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11738414-562c-41b4-ba57-b8aa7e54da1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '52025ce4-f2b7-49bb-a309-47c3d8658f79', 'volume_name': 'volume-52025ce4-f2b7-49bb-a309-47c3d8658f79', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a456d02b-93f0-4475-a463-9ee5fa11d68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a456d02b-93f0-4475-a463-9ee5fa11d68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29dc8a31-08ee-418f-b206-304a2b3ebb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:23 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Volume 52025ce4-f2b7-49bb-a309-47c3d8658f79: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-52025ce4-f2b7-49bb-a309-47c3d8658f79', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 22:28:23 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Trying to clone 52025ce4-f2b7-49bb-a309-47c3d8658f79 from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:28:24 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Image download 20.69 MB at 20.69 MB/s Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeab588-e413-4e2e-ad0f-3bcc98beb319]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2870983a-e907-4753-931d-a2d10b052ea9 tempest-GroupsTest-946082828 None] Group tempest-GroupsTest-Group-856588495: creating Sep 30 22:28:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2870983a-e907-4753-931d-a2d10b052ea9 tempest-GroupsTest-946082828 None] Group tempest-GroupsTest-Group-856588495: created successfully Sep 30 22:28:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2870983a-e907-4753-931d-a2d10b052ea9 tempest-GroupsTest-946082828 None] Create group completed successfully. Sep 30 22:28:24 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD Sep 30 22:28:24 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:24 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a is fetched for user a10ebb774c6649a9bda967f4dce21db3. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f651fb94-e875-41ea-a840-dcba3c7d0cb7]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:24 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD Sep 30 22:28:24 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:24 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-284008279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52025ce4-f2b7-49bb-a309-47c3d8658f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe3185541d34a18b8f7eabdbbe5798f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:24Z,use_quota=True,user_id='a10ebb774c6649a9bda967f4dce21db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Creating volume 52025ce4-f2b7-49bb-a309-47c3d8658f79 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:28:25 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:25 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 1073741824 Sep 30 22:28:25 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:25 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 1073741824" returned: 0 in 0.414s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:25 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 Sep 30 22:28:25 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:25 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79" returned: 0 in 0.265s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Attempting download of 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume 52025ce4-f2b7-49bb-a309-47c3d8658f79. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ff30bc-0400-40c3-b0a2-959a8f5b30c6]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_g2m2xdw4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:25 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_g2m2xdw4 Sep 30 22:28:25 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:28:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Flow 'volume_create_manager' (1e3edee3-23e6-4085-8ae4-096bcb0b9859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf76f75-c431-42a9-b994-7e6b8527257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf76f75-c431-42a9-b994-7e6b8527257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1064843976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7525a697-5a6b-4b9c-aea7-beb9999c2e0a,host='devstack@QuobyteHD#QuobyteHD',id=57086907-7f3b-49be-8f22-6342119ff350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605a925974a346aa87f6176e7a47f49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:26Z,use_quota=True,user_id='3a9ed221957146b0b803592086acf8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0d50f35-9c0b-493d-bc37-7a486d3116ed),volume_type_id=e0d50f35-9c0b-493d-bc37-7a486d3116ed)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac21f86-d126-46e5-a862-76d40af96f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac21f86-d126-46e5-a862-76d40af96f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9a0428-6344-4a74-8595-2e94c86e883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9a0428-6344-4a74-8595-2e94c86e883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57086907-7f3b-49be-8f22-6342119ff350', 'volume_name': 'volume-57086907-7f3b-49be-8f22-6342119ff350', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b5fd1d-c855-4861-ac2b-fd53dd577127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b5fd1d-c855-4861-ac2b-fd53dd577127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789d0ea5-389c-4d77-91fd-e7187f154062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Volume 57086907-7f3b-49be-8f22-6342119ff350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57086907-7f3b-49be-8f22-6342119ff350', 'volume_size': 1} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7525a697-5a6b-4b9c-aea7-beb9999c2e0a,created_at=2026-09-30T20:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1064843976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7525a697-5a6b-4b9c-aea7-beb9999c2e0a,host='devstack@QuobyteHD#QuobyteHD',id=57086907-7f3b-49be-8f22-6342119ff350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605a925974a346aa87f6176e7a47f49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:26Z,use_quota=True,user_id='3a9ed221957146b0b803592086acf8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0d50f35-9c0b-493d-bc37-7a486d3116ed),volume_type_id=e0d50f35-9c0b-493d-bc37-7a486d3116ed)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Creating volume 57086907-7f3b-49be-8f22-6342119ff350 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:28:26 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:26 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350 1073741824 Sep 30 22:28:26 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:26 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_g2m2xdw4" returned: 0 in 0.366s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_g2m2xdw4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:26 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_g2m2xdw4 Sep 30 22:28:26 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:26 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350 1073741824" returned: 0 in 0.415s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:26 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_g2m2xdw4" returned: 1 in 0.341s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_g2m2xdw4' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be50b9e-314d-45e5-a2b2-fb15d50724a1]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:26 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350 Sep 30 22:28:26 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:26 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD Sep 30 22:28:26 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:26 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350" returned: 0 in 0.299s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789d0ea5-389c-4d77-91fd-e7187f154062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57086907-7f3b-49be-8f22-6342119ff350', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5eb6623-b75d-4892-8d37-879237e0537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:26 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a was qcow2, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Volume volume-57086907-7f3b-49be-8f22-6342119ff350 (57086907-7f3b-49be-8f22-6342119ff350): created successfully Sep 30 22:28:26 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 Sep 30 22:28:26 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5eb6623-b75d-4892-8d37-879237e0537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Flow 'volume_create_manager' (1e3edee3-23e6-4085-8ae4-096bcb0b9859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-eeb0f1b8-a1aa-4bb8-a0a0-c60105f963d1 tempest-GroupsTest-946082828 None] Created volume successfully. Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Flow 'volume_create_manager' (6d5dd339-d976-4c46-a9c2-432fedbfb58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c5ec9d-102d-4f6a-854c-a54388fd0f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c5ec9d-102d-4f6a-854c-a54388fd0f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-928926410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7525a697-5a6b-4b9c-aea7-beb9999c2e0a,host='devstack@QuobyteHD#QuobyteHD',id=90b974e7-e08b-4afa-a2d7-74b8051a2177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605a925974a346aa87f6176e7a47f49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:28Z,use_quota=True,user_id='3a9ed221957146b0b803592086acf8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0d50f35-9c0b-493d-bc37-7a486d3116ed),volume_type_id=e0d50f35-9c0b-493d-bc37-7a486d3116ed)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e06ccd-d3f8-48eb-92a7-922215e6288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e06ccd-d3f8-48eb-92a7-922215e6288f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf50f90-73bd-4b5b-ad48-747c450050f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf50f90-73bd-4b5b-ad48-747c450050f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b974e7-e08b-4afa-a2d7-74b8051a2177', 'volume_name': 'volume-90b974e7-e08b-4afa-a2d7-74b8051a2177', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc368c4-129e-4ce9-903e-5ff518ab70dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc368c4-129e-4ce9-903e-5ff518ab70dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38f8e85-602f-4f87-914d-50a865020d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Volume 90b974e7-e08b-4afa-a2d7-74b8051a2177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b974e7-e08b-4afa-a2d7-74b8051a2177', 'volume_size': 1} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7525a697-5a6b-4b9c-aea7-beb9999c2e0a,created_at=2026-09-30T20:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-928926410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7525a697-5a6b-4b9c-aea7-beb9999c2e0a,host='devstack@QuobyteHD#QuobyteHD',id=90b974e7-e08b-4afa-a2d7-74b8051a2177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605a925974a346aa87f6176e7a47f49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:28Z,use_quota=True,user_id='3a9ed221957146b0b803592086acf8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0d50f35-9c0b-493d-bc37-7a486d3116ed),volume_type_id=e0d50f35-9c0b-493d-bc37-7a486d3116ed)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Creating volume 90b974e7-e08b-4afa-a2d7-74b8051a2177 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:28:27 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:28:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:28 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 1073741824 Sep 30 22:28:28 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:28 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 1073741824" returned: 0 in 0.513s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:28 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 Sep 30 22:28:28 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:28 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177" returned: 0 in 0.279s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38f8e85-602f-4f87-914d-50a865020d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b974e7-e08b-4afa-a2d7-74b8051a2177', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e481e57-3d78-4f66-a135-b011d80c1796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Volume volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 (90b974e7-e08b-4afa-a2d7-74b8051a2177): created successfully Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e481e57-3d78-4f66-a135-b011d80c1796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Flow 'volume_create_manager' (6d5dd339-d976-4c46-a9c2-432fedbfb58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0062d2d8-d7ad-4df3-834d-802087cafd8b tempest-GroupsTest-946082828 None] Created volume successfully. Sep 30 22:28:28 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79" returned: 0 in 2.044s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_fugw5b_cdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:28:28 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Converted 112.00 MB image at 54.78 MB/s Sep 30 22:28:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:28 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 1G Sep 30 22:28:28 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e1796ae2-4107-4bf2-9fb7-e1ef5cefddd9 tempest-GroupsTest-946082828 None] Update group completed successfully. Sep 30 22:28:29 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 1G" returned: 0 in 0.333s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Downloaded image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume 52025ce4-f2b7-49bb-a309-47c3d8658f79 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a for user a10ebb774c6649a9bda967f4dce21db3 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Marking volume 52025ce4-f2b7-49bb-a309-47c3d8658f79 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Copying metadata from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a to 52025ce4-f2b7-49bb-a309-47c3d8658f79. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Creating volume glance metadata for volume 52025ce4-f2b7-49bb-a309-47c3d8658f79 backed by image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29dc8a31-08ee-418f-b206-304a2b3ebb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52025ce4-f2b7-49bb-a309-47c3d8658f79', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93284e83-b257-445b-b0e6-c356b156b0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Volume volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 (52025ce4-f2b7-49bb-a309-47c3d8658f79): created successfully Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93284e83-b257-445b-b0e6-c356b156b0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Flow 'volume_create_manager' (7a131048-303f-490f-8c4b-699e985de50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a5be2b38-0d97-47a2-be42-dbe52d21dcbb tempest-VolumesExtendTest-1091926883 None] Created volume successfully. Sep 30 22:28:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fba37381-1709-4fee-b62f-fd1934129329 tempest-VolumesExtendTest-1091926883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fba37381-1709-4fee-b62f-fd1934129329 tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a60850-2a48-47d6-bb45-873eddc5fd7e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fba37381-1709-4fee-b62f-fd1934129329 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:30 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 Sep 30 22:28:30 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:30 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fba37381-1709-4fee-b62f-fd1934129329 tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79" returned: 0 in 0.377s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fba37381-1709-4fee-b62f-fd1934129329 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 2G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-46cd27fd-786a-4ec3-a5c7-8f467187ef1b tempest-GroupsTest-946082828 None] Update group completed successfully. Sep 30 22:28:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fba37381-1709-4fee-b62f-fd1934129329 tempest-VolumesExtendTest-1091926883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 2G" returned: 0 in 0.113s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fba37381-1709-4fee-b62f-fd1934129329 tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.512s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fba37381-1709-4fee-b62f-fd1934129329 tempest-VolumesExtendTest-1091926883 None] Extend volume completed successfully. Sep 30 22:28:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Acquiring lock "cinder-52025ce4-f2b7-49bb-a309-47c3d8658f79-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Lock "cinder-52025ce4-f2b7-49bb-a309-47c3d8658f79-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Acquiring lock "cinder-quobyte-52025ce4-f2b7-49bb-a309-47c3d8658f79" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Lock "cinder-quobyte-52025ce4-f2b7-49bb-a309-47c3d8658f79" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02c73b7-3568-465b-9d5c-89901394c8db]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:31 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 Sep 30 22:28:31 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:31 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79" returned: 0 in 0.368s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:31 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79 Sep 30 22:28:31 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:32 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-52025ce4-f2b7-49bb-a309-47c3d8658f79" returned: 0 in 0.258s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Lock "cinder-quobyte-52025ce4-f2b7-49bb-a309-47c3d8658f79" released by "delete_volume" :: held 0.668s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Acquiring lock "cinder-quobyte-57086907-7f3b-49be-8f22-6342119ff350" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Created reservations ['ad25d9db-2e87-4e73-b010-5391f1fe3416', '52ceba04-9b3e-4a22-b88a-5299897a1ec6', 'bc6aa2ca-979c-466f-a53d-d757001761df', '9662a82b-0101-4e53-9984-ba6c10f9ef04'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Lock "cinder-quobyte-57086907-7f3b-49be-8f22-6342119ff350" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5742740-d128-4b02-bd1e-92e4d2c3414c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:32 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:32 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:32 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350 Sep 30 22:28:32 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:32 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.279s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Deleted volume successfully. Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fad42ddc-4fee-4b78-b1b8-d86fc744c208 tempest-VolumesExtendTest-1091926883 None] Lock "cinder-52025ce4-f2b7-49bb-a309-47c3d8658f79-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:32 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350" returned: 0 in 0.402s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:32 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350 Sep 30 22:28:32 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:32 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-57086907-7f3b-49be-8f22-6342119ff350" returned: 0 in 0.282s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Lock "cinder-quobyte-57086907-7f3b-49be-8f22-6342119ff350" released by "delete_volume" :: held 0.734s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Acquiring lock "cinder-quobyte-90b974e7-e08b-4afa-a2d7-74b8051a2177" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Lock "cinder-quobyte-90b974e7-e08b-4afa-a2d7-74b8051a2177" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc9632-c61c-4c09-9bdd-a13b37fba458]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Flow 'volume_create_manager' (3c12c8aa-8d69-4118-9aca-883fa3488158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54fe00c-e4a9-4652-abca-7d6290a0eef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:33 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 Sep 30 22:28:33 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54fe00c-e4a9-4652-abca-7d6290a0eef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-77220196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ec61c0-56f1-456e-a8e6-6e45cb143103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe3185541d34a18b8f7eabdbbe5798f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:33Z,use_quota=True,user_id='a10ebb774c6649a9bda967f4dce21db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b795ea2f-56a1-419d-a217-304b3cf38133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b795ea2f-56a1-419d-a217-304b3cf38133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76ed5e3-ee66-487e-8db8-136b0e888188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76ed5e3-ee66-487e-8db8-136b0e888188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ec61c0-56f1-456e-a8e6-6e45cb143103', 'volume_name': 'volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddf5a7b-a22f-4350-b249-823bed9ee509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ddf5a7b-a22f-4350-b249-823bed9ee509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687c2cfb-e60a-4397-bcc9-0ac24a430d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Volume c1ec61c0-56f1-456e-a8e6-6e45cb143103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103', 'volume_size': 1} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-77220196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ec61c0-56f1-456e-a8e6-6e45cb143103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe3185541d34a18b8f7eabdbbe5798f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:33Z,use_quota=True,user_id='a10ebb774c6649a9bda967f4dce21db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Creating volume c1ec61c0-56f1-456e-a8e6-6e45cb143103 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:28:33 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:33 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 1073741824 Sep 30 22:28:33 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:33 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177" returned: 0 in 0.387s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:33 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177 Sep 30 22:28:33 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:33 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 1073741824" returned: 0 in 0.437s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:33 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90b974e7-e08b-4afa-a2d7-74b8051a2177" returned: 0 in 0.279s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Lock "cinder-quobyte-90b974e7-e08b-4afa-a2d7-74b8051a2177" released by "delete_volume" :: held 0.719s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:33 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 Sep 30 22:28:33 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Created reservations ['34c0b463-e6e4-4e1f-a526-afcd8e61ae4f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:33 devstack cinder-volume[87240]: WARNING cinder.quota [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1287650007 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1287650007, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:28:33 devstack cinder-volume[87240]: WARNING cinder.quota [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1287650007 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1287650007, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Created reservations ['b28c1070-189a-454d-9110-3670c085b744', '9bbce1e3-83eb-4120-9b57-5b2a57650580', '8b834a5d-e394-4517-9802-9c3b78229e6e', '484a047a-2446-416a-b333-55ad6e857e85'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Created reservations ['a90c6e59-355e-4bc5-9aa3-a9a2887f8686', '1a1a2fd8-5d6c-4a15-90b0-ebd3dcd686a8', 'e78a6b28-5ab0-4877-b52e-609f3683bd2d', '510afa77-4c4e-43ce-b5cd-3f12cd08adc1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:33 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103" returned: 0 in 0.268s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687c2cfb-e60a-4397-bcc9-0ac24a430d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5024add-4b2d-4421-8ab5-153a8fdf2213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Volume volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 (c1ec61c0-56f1-456e-a8e6-6e45cb143103): created successfully Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5024add-4b2d-4421-8ab5-153a8fdf2213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Flow 'volume_create_manager' (3c12c8aa-8d69-4118-9aca-883fa3488158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:33 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-26965297-fb47-4108-b121-d64cdf8c903f tempest-VolumesExtendTest-1091926883 None] Created volume successfully. Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:34 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:34 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:34 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:34 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fdfb9460-78dc-4c63-9d90-8aa991f21f7f tempest-GroupsTest-946082828 None] Delete group completed successfully. Sep 30 22:28:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Creating offline snapshot f6ad19ee-291e-49f8-a50d-a26c41926ecb of volume c1ec61c0-56f1-456e-a8e6-6e45cb143103 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:28:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bcde59-17b0-4973-9957-595ea450f312]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:35 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 Sep 30 22:28:35 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:35 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103" returned: 0 in 0.386s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:35 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb 1G Sep 30 22:28:35 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:36 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb 1G" returned: 0 in 0.420s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:36 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb Sep 30 22:28:36 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:36 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb" returned: 0 in 0.327s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:36 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb is being set with open permissions: ugo+rw Sep 30 22:28:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:36 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb Sep 30 22:28:36 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:36 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb" returned: 0 in 0.265s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:36 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.info Sep 30 22:28:36 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:37 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.info" returned: 0 in 0.284s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:37 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.info is being set with open permissions: ugo+rw Sep 30 22:28:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:37 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.info Sep 30 22:28:37 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:37 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.info" returned: 0 in 0.274s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-87abac1a-c6e6-47bb-a1a8-f4b8da0c00b2 tempest-VolumesExtendTest-1091926883 None] Create snapshot completed successfully Sep 30 22:28:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-365ac7a6-f178-4cc9-83b7-27611306e1d5 tempest-VolumesExtendTest-1091926883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-365ac7a6-f178-4cc9-83b7-27611306e1d5 tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[919da7b2-31bf-42bb-9056-577073925e7e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-365ac7a6-f178-4cc9-83b7-27611306e1d5 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:38 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 Sep 30 22:28:38 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:38 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-365ac7a6-f178-4cc9-83b7-27611306e1d5 tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103" returned: 0 in 0.386s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-365ac7a6-f178-4cc9-83b7-27611306e1d5 tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb 2G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-365ac7a6-f178-4cc9-83b7-27611306e1d5 tempest-VolumesExtendTest-1091926883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb 2G" returned: 0 in 0.134s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-365ac7a6-f178-4cc9-83b7-27611306e1d5 tempest-VolumesExtendTest-1091926883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.562s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-365ac7a6-f178-4cc9-83b7-27611306e1d5 tempest-VolumesExtendTest-1091926883 None] Extend volume completed successfully. Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Acquiring lock "cinder-f6ad19ee-291e-49f8-a50d-a26c41926ecb-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Lock "cinder-f6ad19ee-291e-49f8-a50d-a26c41926ecb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Acquiring lock "cinder-quobyte-c1ec61c0-56f1-456e-a8e6-6e45cb143103" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Lock "cinder-quobyte-c1ec61c0-56f1-456e-a8e6-6e45cb143103" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Acquiring lock "cinder-quobyte-f6ad19ee-291e-49f8-a50d-a26c41926ecb" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Lock "cinder-quobyte-f6ad19ee-291e-49f8-a50d-a26c41926ecb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Deleting offline snapshot f6ad19ee-291e-49f8-a50d-a26c41926ecb of volume c1ec61c0-56f1-456e-a8e6-6e45cb143103 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] snapshot_file for this snap is: volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e119703c-a975-40b2-8d83-b777e62b42ed]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:39 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb Sep 30 22:28:39 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4fbd2aff-066f-4573-b317-44f28890688a tempest-GroupsV314Test-2037874728 None] Group tempest-GroupsV314Test-Group-151208072: creating Sep 30 22:28:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4fbd2aff-066f-4573-b317-44f28890688a tempest-GroupsV314Test-2037874728 None] Group tempest-GroupsV314Test-Group-151208072: created successfully Sep 30 22:28:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4fbd2aff-066f-4573-b317-44f28890688a tempest-GroupsV314Test-2037874728 None] Create group completed successfully. Sep 30 22:28:40 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb" returned: 0 in 0.383s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:28:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[927f853a-6c33-4e06-aacf-398379a58dd7]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:40 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 Sep 30 22:28:40 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:40 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103" returned: 0 in 0.355s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:40 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb Sep 30 22:28:40 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:40 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:40 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb Sep 30 22:28:40 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:41 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103.f6ad19ee-291e-49f8-a50d-a26c41926ecb" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Lock "cinder-quobyte-f6ad19ee-291e-49f8-a50d-a26c41926ecb" released by "_delete_snapshot" :: held 1.443s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Lock "cinder-quobyte-c1ec61c0-56f1-456e-a8e6-6e45cb143103" released by "delete_snapshot" :: held 1.467s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Created reservations ['fbf10e4e-87ee-4616-8bf3-b112766b230c', '31951edc-fb3b-4631-a160-940264ec348a', 'df83a673-422a-4fdc-8fd9-1cf206708b79', '2dfb122f-5619-4e0b-866b-789720bbfc06'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Delete snapshot completed successfully. Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a01c9f1-cc60-4aad-8b7e-a006451991fb tempest-VolumesExtendTest-1091926883 None] Lock "cinder-f6ad19ee-291e-49f8-a50d-a26c41926ecb-delete_snapshot" released by "delete_snapshot" :: held 1.610s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Flow 'volume_create_manager' (4ea3af86-7dd9-4422-864e-fd32e65da0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafa3685-7aab-47dd-bf6e-401a43d9ee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafa3685-7aab-47dd-bf6e-401a43d9ee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-23516302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54f3370b-2107-44a3-8ce3-6034d7a578fb,host='devstack@QuobyteHD#QuobyteHD',id=08302e94-bba2-429b-a0c6-a778dda08050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dcbc0186774a18b4de8b0b1332e9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:42Z,use_quota=True,user_id='e372e13c9c024f74b9d9e26755592b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(380a4811-4658-4e44-bbc8-385cfa19ce0a),volume_type_id=380a4811-4658-4e44-bbc8-385cfa19ce0a)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07001b1-8824-4a56-9edf-734bf80f4cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07001b1-8824-4a56-9edf-734bf80f4cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54489c8-c6f9-42e9-9f59-6e781640efcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54489c8-c6f9-42e9-9f59-6e781640efcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08302e94-bba2-429b-a0c6-a778dda08050', 'volume_name': 'volume-08302e94-bba2-429b-a0c6-a778dda08050', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0940232-281c-4cf2-8d65-2139e1b653b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0940232-281c-4cf2-8d65-2139e1b653b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e21892-73eb-4cbc-a4cc-1abfbf9a76b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Volume 08302e94-bba2-429b-a0c6-a778dda08050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08302e94-bba2-429b-a0c6-a778dda08050', 'volume_size': 1} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54f3370b-2107-44a3-8ce3-6034d7a578fb,created_at=2026-09-30T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-23516302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54f3370b-2107-44a3-8ce3-6034d7a578fb,host='devstack@QuobyteHD#QuobyteHD',id=08302e94-bba2-429b-a0c6-a778dda08050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dcbc0186774a18b4de8b0b1332e9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:42Z,use_quota=True,user_id='e372e13c9c024f74b9d9e26755592b1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(380a4811-4658-4e44-bbc8-385cfa19ce0a),volume_type_id=380a4811-4658-4e44-bbc8-385cfa19ce0a)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Creating volume 08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:28:41 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:41 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 1073741824 Sep 30 22:28:41 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Acquiring lock "cinder-c1ec61c0-56f1-456e-a8e6-6e45cb143103-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Lock "cinder-c1ec61c0-56f1-456e-a8e6-6e45cb143103-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Acquiring lock "cinder-quobyte-c1ec61c0-56f1-456e-a8e6-6e45cb143103" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Lock "cinder-quobyte-c1ec61c0-56f1-456e-a8e6-6e45cb143103" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6f4e46-b941-4124-ba1e-9bc8d7465e41]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:42 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 Sep 30 22:28:42 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:42 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 1073741824" returned: 0 in 0.439s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:42 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 Sep 30 22:28:42 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:42 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103" returned: 0 in 0.379s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:42 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103 Sep 30 22:28:42 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:42 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e21892-73eb-4cbc-a4cc-1abfbf9a76b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08302e94-bba2-429b-a0c6-a778dda08050', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9fb4a0-1d6a-4e63-93fc-3a27492e2b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Volume volume-08302e94-bba2-429b-a0c6-a778dda08050 (08302e94-bba2-429b-a0c6-a778dda08050): created successfully Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9fb4a0-1d6a-4e63-93fc-3a27492e2b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Flow 'volume_create_manager' (4ea3af86-7dd9-4422-864e-fd32e65da0bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8464196c-1099-4a3d-b24d-43a675f468d3 tempest-GroupsV314Test-2037874728 None] Created volume successfully. Sep 30 22:28:42 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c1ec61c0-56f1-456e-a8e6-6e45cb143103" returned: 0 in 0.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Lock "cinder-quobyte-c1ec61c0-56f1-456e-a8e6-6e45cb143103" released by "delete_volume" :: held 0.693s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Created reservations ['aa725325-16eb-4bee-80fe-e7bfda2c514a', '650257fb-c88b-4b9f-b5f7-12e7081cf021', 'd6c08afa-d382-4f53-afcc-f832630f29ff', '5b436b8b-7fcd-471f-a78a-f2b23f09bf26'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:42 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:42 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:43 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.261s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Deleted volume successfully. Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-367c8536-4fad-4f33-a18d-9cb32b01dfad tempest-VolumesExtendTest-1091926883 None] Lock "cinder-c1ec61c0-56f1-456e-a8e6-6e45cb143103-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:43 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Cloning volume 08302e94-bba2-429b-a0c6-a778dda08050 to volume bc5039d0-14fb-46c2-90b0-9383014a2d5a Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Creating offline snapshot de01842b-864b-49ce-8572-7191fa435d7d of volume 08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc30977-de3c-4dee-8a8a-c147bb824d5f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:43 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 Sep 30 22:28:43 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:43 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050" returned: 0 in 0.396s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:43 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d 1G Sep 30 22:28:43 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:44 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d 1G" returned: 0 in 0.427s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08302e94-bba2-429b-a0c6-a778dda08050 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:44 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08302e94-bba2-429b-a0c6-a778dda08050 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d Sep 30 22:28:44 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:44 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08302e94-bba2-429b-a0c6-a778dda08050 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d" returned: 0 in 0.308s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:44 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:28:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:44 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d Sep 30 22:28:44 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:44 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d" returned: 0 in 0.285s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:45 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.info Sep 30 22:28:45 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:45 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.info" returned: 0 in 0.279s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:45 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.info is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:45 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.info Sep 30 22:28:45 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:45 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.info" returned: 0 in 0.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Acquiring lock "cinder-quobyte-bc5039d0-14fb-46c2-90b0-9383014a2d5a" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Lock "cinder-quobyte-bc5039d0-14fb-46c2-90b0-9383014a2d5a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] snapshot: de01842b-864b-49ce-8572-7191fa435d7d, volume: bc5039d0-14fb-46c2-90b0-9383014a2d5a, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[21372273-5411-4768-b3c4-3e3e56f580ca]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:45 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d Sep 30 22:28:45 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:46 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d" returned: 0 in 0.380s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08302e94-bba2-429b-a0c6-a778dda08050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[befe5b52-e8e1-44f9-b3f8-0820cdf31b60]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:46 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 Sep 30 22:28:46 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:28:46 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Flow 'volume_create_manager' (305d61e4-90eb-4b12-bf20-77bab3b695e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36762d32-b951-4935-b18d-16ec007c4381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050" returned: 0 in 0.395s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36762d32-b951-4935-b18d-16ec007c4381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1723350379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d60244-339e-46ec-8218-3573030e1f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b438b50b094baeb09f7e4c5109f8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:46Z,use_quota=True,user_id='851c520ac6324e5983999392a76bf9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:46 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a Sep 30 22:28:46 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5a0273-ac0f-40d9-891d-91726db0ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5a0273-ac0f-40d9-891d-91726db0ead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15544be4-6d77-48a2-8e13-9f8c1efd76a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15544be4-6d77-48a2-8e13-9f8c1efd76a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d60244-339e-46ec-8218-3573030e1f4b', 'volume_name': 'volume-d0d60244-339e-46ec-8218-3573030e1f4b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e3d82f-95ed-4246-a8fa-bbbf26ac30f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e3d82f-95ed-4246-a8fa-bbbf26ac30f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a36266-8ffa-4d5d-902e-65b5af992f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Volume d0d60244-339e-46ec-8218-3573030e1f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d60244-339e-46ec-8218-3573030e1f4b', 'volume_size': 1} Sep 30 22:28:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:52 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a" returned: 0 in 6.026s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:28:52 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Converted 1024.00 MB image at 169.89 MB/s Sep 30 22:28:52 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a is being set with open permissions: ugo+rw: NotImplementedError Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:52 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a Sep 30 22:28:52 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:52 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a" returned: 0 in 0.233s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Lock "cinder-quobyte-bc5039d0-14fb-46c2-90b0-9383014a2d5a" released by "_copy_volume_from_snapshot" :: held 7.115s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Acquiring lock "cinder-quobyte-de01842b-864b-49ce-8572-7191fa435d7d" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Lock "cinder-quobyte-de01842b-864b-49ce-8572-7191fa435d7d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Deleting offline snapshot de01842b-864b-49ce-8572-7191fa435d7d of volume 08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] snapshot_file for this snap is: volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[247acd78-094b-4481-904c-3febd3dc46f3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:52 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d Sep 30 22:28:52 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:53 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d" returned: 0 in 0.346s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08302e94-bba2-429b-a0c6-a778dda08050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:28:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04f37d7-4c73-4e79-babe-14374324e688]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:53 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 Sep 30 22:28:53 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:53 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050" returned: 0 in 0.551s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:53 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d Sep 30 22:28:53 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:54 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d" returned: 0 in 0.315s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:54 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d Sep 30 22:28:54 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:54 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050.de01842b-864b-49ce-8572-7191fa435d7d" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Lock "cinder-quobyte-de01842b-864b-49ce-8572-7191fa435d7d" released by "_delete_snapshot" :: held 1.542s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.795s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.804s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1723350379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d60244-339e-46ec-8218-3573030e1f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b438b50b094baeb09f7e4c5109f8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:46Z,use_quota=True,user_id='851c520ac6324e5983999392a76bf9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Creating volume d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:28:54 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:54 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b 1073741824 Sep 30 22:28:54 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fa4f1487-df78-4a95-8989-f68f5425a4bc tempest-GroupsV314Test-2037874728 None] Create group from source-group-54f3370b-2107-44a3-8ce3-6034d7a578fb completed successfully. Sep 30 22:28:54 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b 1073741824" returned: 0 in 0.408s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:54 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b Sep 30 22:28:54 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:55 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b" returned: 0 in 0.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a36266-8ffa-4d5d-902e-65b5af992f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d60244-339e-46ec-8218-3573030e1f4b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c61631-0f71-4448-ae49-1c24e2f980fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Volume volume-d0d60244-339e-46ec-8218-3573030e1f4b (d0d60244-339e-46ec-8218-3573030e1f4b): created successfully Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c61631-0f71-4448-ae49-1c24e2f980fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Flow 'volume_create_manager' (305d61e4-90eb-4b12-bf20-77bab3b695e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-594b45ac-61b3-49fc-8631-a788fe0a35c0 tempest-VolumeDependencyTests-1819563098 None] Created volume successfully. Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Acquiring lock "cinder-quobyte-bc5039d0-14fb-46c2-90b0-9383014a2d5a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Lock "cinder-quobyte-bc5039d0-14fb-46c2-90b0-9383014a2d5a" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f8acec-6e19-43ce-a722-488ddea30cf4]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:55 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a Sep 30 22:28:55 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:55 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a" returned: 0 in 0.355s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:55 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a Sep 30 22:28:55 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:55 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc5039d0-14fb-46c2-90b0-9383014a2d5a" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Lock "cinder-quobyte-bc5039d0-14fb-46c2-90b0-9383014a2d5a" released by "delete_volume" :: held 0.643s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Created reservations ['2a0099e5-a3c1-4ae1-b3b8-d5e7cfc93d78'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:55 devstack cinder-volume[87240]: WARNING cinder.quota [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-611852404 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-611852404, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:28:55 devstack cinder-volume[87240]: WARNING cinder.quota [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-611852404 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-611852404, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:28:55 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Created reservations ['01383fe4-3720-4f94-9d67-debe5c8d07b2', 'f3f375db-84ff-457c-b46a-f1f0bdb53503', '0695d367-e1a1-435d-bc5f-3c807b9cd35c', '9fbe3129-126a-43ab-b02f-4d90f6b1a714'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:56 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:56 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Creating offline snapshot a3e5243c-438e-4e7c-9286-07c278d03934 of volume d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3d070d-fc8d-421a-b554-992e40196209]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:56 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.273s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-401b2519-e19b-4224-86ab-e23f63f0397f tempest-GroupsV314Test-2037874728 None] Delete group completed successfully. Sep 30 22:28:56 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b Sep 30 22:28:56 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:56 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b" returned: 0 in 0.368s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Acquiring lock "cinder-quobyte-08302e94-bba2-429b-a0c6-a778dda08050" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:56 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 1G Sep 30 22:28:56 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Lock "cinder-quobyte-08302e94-bba2-429b-a0c6-a778dda08050" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2109fa4-3132-40df-a9c4-fbde026d7b25]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:56 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 Sep 30 22:28:56 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:57 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 1G" returned: 0 in 0.404s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0d60244-339e-46ec-8218-3573030e1f4b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:57 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0d60244-339e-46ec-8218-3573030e1f4b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 Sep 30 22:28:57 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:57 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050" returned: 0 in 0.388s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:57 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050 Sep 30 22:28:57 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:57 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0d60244-339e-46ec-8218-3573030e1f4b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934" returned: 0 in 0.298s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:57 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 is being set with open permissions: ugo+rw Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:57 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 Sep 30 22:28:57 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:57 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08302e94-bba2-429b-a0c6-a778dda08050" returned: 0 in 0.265s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Lock "cinder-quobyte-08302e94-bba2-429b-a0c6-a778dda08050" released by "delete_volume" :: held 0.736s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Created reservations ['13c5bf90-c3f3-4a07-94c3-3393bfe3d240'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Created reservations ['6831c1a8-69c3-4146-8048-fa0db4d55d9d', '88b262b4-bffb-421c-829c-7b739e620642', '7854a082-49f8-4c94-a820-4c288a742c0a', '85c0c6f3-d03e-424a-8349-9db718ba7307'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:28:57 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934" returned: 0 in 0.258s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:57 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:28:57 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:57 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.info Sep 30 22:28:57 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:57 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.275s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:28:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d3014b01-dad3-45d2-bec4-6c17ace0df53 tempest-GroupsV314Test-2037874728 None] Delete group completed successfully. Sep 30 22:28:57 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.info" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:57 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.info is being set with open permissions: ugo+rw Sep 30 22:28:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:57 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.info Sep 30 22:28:57 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:58 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.info" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5e17559c-0d91-4e2d-ba18-af89d5e58b9e tempest-VolumeDependencyTests-1819563098 None] Create snapshot completed successfully Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Flow 'volume_create_manager' (6b0c6531-6574-49ef-a1ae-e61232b685f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c90d239-1bb2-4846-84bc-ae4147b0f34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c90d239-1bb2-4846-84bc-ae4147b0f34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1822273773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a949ded0-bc1c-448d-b85a-7825da81e5ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b438b50b094baeb09f7e4c5109f8fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a3e5243c-438e-4e7c-9286-07c278d03934,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:28:59Z,use_quota=True,user_id='851c520ac6324e5983999392a76bf9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18ef457-e799-4683-af75-26173b1a747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18ef457-e799-4683-af75-26173b1a747e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74397573-b658-4141-917f-df85a6639184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74397573-b658-4141-917f-df85a6639184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a949ded0-bc1c-448d-b85a-7825da81e5ac', 'volume_name': 'volume-a949ded0-bc1c-448d-b85a-7825da81e5ac', 'volume_size': 1, 'snapshot_id': 'a3e5243c-438e-4e7c-9286-07c278d03934'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db427bc-549a-492c-b70a-c7b4a179df3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db427bc-549a-492c-b70a-c7b4a179df3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36a2729-c2b4-4ac1-8ca5-c2076094b9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:28:58 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Volume a949ded0-bc1c-448d-b85a-7825da81e5ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a949ded0-bc1c-448d-b85a-7825da81e5ac', 'volume_size': 1, 'snapshot_id': 'a3e5243c-438e-4e7c-9286-07c278d03934'} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "cinder-quobyte-a3e5243c-438e-4e7c-9286-07c278d03934-a949ded0-bc1c-448d-b85a-7825da81e5ac" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-a3e5243c-438e-4e7c-9286-07c278d03934-a949ded0-bc1c-448d-b85a-7825da81e5ac" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Creating volume a949ded0-bc1c-448d-b85a-7825da81e5ac from snapshot a3e5243c-438e-4e7c-9286-07c278d03934 {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "cinder-quobyte-a949ded0-bc1c-448d-b85a-7825da81e5ac" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-a949ded0-bc1c-448d-b85a-7825da81e5ac" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] snapshot: a3e5243c-438e-4e7c-9286-07c278d03934, volume: a949ded0-bc1c-448d-b85a-7825da81e5ac, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3f9d5d-21a3-434a-baeb-923f517a7485]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:59 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 Sep 30 22:28:59 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:59 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934" returned: 0 in 0.387s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0d60244-339e-46ec-8218-3573030e1f4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acda2cc-130d-4ddc-86c5-f79ac143ea7a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:59 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b Sep 30 22:28:59 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:28:59 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b" returned: 0 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:28:59 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac Sep 30 22:28:59 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:03 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:29:03 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:03 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.591s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:29:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:29:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-642f282b-bcc4-4d7f-941a-7fa3a88bbf2f tempest-GroupsV320Test-1619984391 None] Group tempest-GroupsV320Test-Group-319884110: creating Sep 30 22:29:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-642f282b-bcc4-4d7f-941a-7fa3a88bbf2f tempest-GroupsV320Test-1619984391 None] Group tempest-GroupsV320Test-Group-319884110: created successfully Sep 30 22:29:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-642f282b-bcc4-4d7f-941a-7fa3a88bbf2f tempest-GroupsV320Test-1619984391 None] Create group completed successfully. Sep 30 22:29:06 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac" returned: 0 in 6.943s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:06 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:29:06 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Converted 1024.00 MB image at 147.46 MB/s Sep 30 22:29:06 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac is being set with open permissions: ugo+rw Sep 30 22:29:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:06 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac Sep 30 22:29:06 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] Created reservations ['c7b1d656-c6c8-498e-8560-4a2329a9c84e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:29:07 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac" returned: 0 in 0.258s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-a949ded0-bc1c-448d-b85a-7825da81e5ac" released by "_copy_volume_from_snapshot" :: held 8.074s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:07 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:29:07 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-a3e5243c-438e-4e7c-9286-07c278d03934-a949ded0-bc1c-448d-b85a-7825da81e5ac" released by "_create_volume_from_snapshot" :: held 8.139s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.155s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36a2729-c2b4-4ac1-8ca5-c2076094b9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a949ded0-bc1c-448d-b85a-7825da81e5ac', 'volume_size': 1, 'snapshot_id': 'a3e5243c-438e-4e7c-9286-07c278d03934'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0147b5-d0a4-4684-8b8a-4f4d2a04df54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Volume volume-a949ded0-bc1c-448d-b85a-7825da81e5ac (a949ded0-bc1c-448d-b85a-7825da81e5ac): created successfully Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0147b5-d0a4-4684-8b8a-4f4d2a04df54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Flow 'volume_create_manager' (6b0c6531-6574-49ef-a1ae-e61232b685f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:29:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0bc865ea-fa76-4fab-94c6-848585c79cbd tempest-VolumeDependencyTests-1819563098 None] Created volume successfully. Sep 30 22:29:07 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:29:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-76c804bd-57d1-48f4-bd26-5589a2bd087d tempest-GroupsV320Test-1619984391 None] Delete group completed successfully. Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "cinder-a3e5243c-438e-4e7c-9286-07c278d03934-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-a3e5243c-438e-4e7c-9286-07c278d03934-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "cinder-quobyte-d0d60244-339e-46ec-8218-3573030e1f4b" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-d0d60244-339e-46ec-8218-3573030e1f4b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "cinder-quobyte-a3e5243c-438e-4e7c-9286-07c278d03934" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-a3e5243c-438e-4e7c-9286-07c278d03934" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Deleting offline snapshot a3e5243c-438e-4e7c-9286-07c278d03934 of volume d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] snapshot_file for this snap is: volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5bef49-98df-4cd0-bd22-2b38f661b1b9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:07 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 Sep 30 22:29:07 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:08 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0d60244-339e-46ec-8218-3573030e1f4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:29:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38233b0-b535-41e4-8783-7b238c035b09]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:08 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b Sep 30 22:29:08 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:08 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b" returned: 0 in 0.571s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:08 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 Sep 30 22:29:08 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:09 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:09 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934 Sep 30 22:29:09 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:09 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b.a3e5243c-438e-4e7c-9286-07c278d03934" returned: 0 in 0.263s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-a3e5243c-438e-4e7c-9286-07c278d03934" released by "_delete_snapshot" :: held 1.663s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-d0d60244-339e-46ec-8218-3573030e1f4b" released by "delete_snapshot" :: held 1.687s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Created reservations ['1297acff-5944-432d-a8f3-44672c9b6c10', 'd12dfda6-7576-4f7e-a819-da35d20bee19', '3e1fef5d-020a-4dd4-8112-7601038fa386', 'c5836575-e75f-444d-b8b9-e0f0ffbf4614'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:29:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Delete snapshot completed successfully. Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-820309f8-fcfd-4884-8d6d-f7ba305fff0f tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-a3e5243c-438e-4e7c-9286-07c278d03934-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "cinder-d0d60244-339e-46ec-8218-3573030e1f4b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-d0d60244-339e-46ec-8218-3573030e1f4b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "cinder-quobyte-d0d60244-339e-46ec-8218-3573030e1f4b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-d0d60244-339e-46ec-8218-3573030e1f4b" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee56de6a-eafc-4e31-a756-0c015a361e42]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:10 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b Sep 30 22:29:10 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:10 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b" returned: 0 in 0.398s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:10 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b Sep 30 22:29:10 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:10 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d0d60244-339e-46ec-8218-3573030e1f4b" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-d0d60244-339e-46ec-8218-3573030e1f4b" released by "delete_volume" :: held 0.726s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Created reservations ['60d19226-6dcd-41f7-85ae-7324ba48b872', '2cd87999-0d99-4eb6-a9e9-862b06059ecf', '83365b28-687f-4495-9680-de36bda50ffa', '7f1ffc96-a564-46a7-80c6-890dbf65a7ca'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:10 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:29:10 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "cinder-a949ded0-bc1c-448d-b85a-7825da81e5ac-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-a949ded0-bc1c-448d-b85a-7825da81e5ac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:11 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.289s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:29:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Deleted volume successfully. Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5e4ff90-38ad-43b7-a654-711e04fa17a6 tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-d0d60244-339e-46ec-8218-3573030e1f4b-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "cinder-quobyte-a949ded0-bc1c-448d-b85a-7825da81e5ac" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-a949ded0-bc1c-448d-b85a-7825da81e5ac" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeb1b3e-0ea6-47bd-8403-d6ea8923ac98]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:11 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac Sep 30 22:29:11 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:11 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:11 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac Sep 30 22:29:11 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:11 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a949ded0-bc1c-448d-b85a-7825da81e5ac" returned: 0 in 0.263s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-quobyte-a949ded0-bc1c-448d-b85a-7825da81e5ac" released by "delete_volume" :: held 0.676s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Created reservations ['f431e419-b989-4639-8afb-694d1c1be45e', 'ebe22e4d-60f7-40fa-9af4-e65643b20a57', '3d8ca42c-4431-4600-8678-8f7a8cbf270b', '7197dbad-ebc6-4903-a2bc-752823ddbbd0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:11 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:29:11 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:12 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:12 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:29:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Deleted volume successfully. Sep 30 22:29:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-341fb56d-bc85-46f1-92d9-9d8ade976a35 tempest-VolumeDependencyTests-1819563098 None] Lock "cinder-a949ded0-bc1c-448d-b85a-7825da81e5ac-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:21 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=164,cinder:INSERT=45,cinder:UPDATE=171,cinder:DELETE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:29:22 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=173,cinder:DELETE=14,cinder:INSERT=44,cinder:SELECT=135 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Flow 'volume_create_manager' (3d92d89b-b608-46e4-9a2b-e8aa7bfac29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b35de7-1c7a-4377-ab84-a932569dbd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b35de7-1c7a-4377-ab84-a932569dbd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1240601532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f13cf9-8323-439f-a332-e607a84a3b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ef0c4ece7a4e10bec432bff7ebf994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:29:38Z,use_quota=True,user_id='4a50666f54f8450fbbacf89223a08017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943ae770-35a0-419b-8c77-3af03b577137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943ae770-35a0-419b-8c77-3af03b577137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0537d6-b617-4720-b4dc-9a7557f3b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0537d6-b617-4720-b4dc-9a7557f3b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f13cf9-8323-439f-a332-e607a84a3b62', 'volume_name': 'volume-e5f13cf9-8323-439f-a332-e607a84a3b62', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113efc35-ba2d-4994-9664-228714160a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (113efc35-ba2d-4994-9664-228714160a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71fdd5c-5625-49f4-87ca-3ac8fb787b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Volume e5f13cf9-8323-439f-a332-e607a84a3b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f13cf9-8323-439f-a332-e607a84a3b62', 'volume_size': 1} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1240601532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f13cf9-8323-439f-a332-e607a84a3b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ef0c4ece7a4e10bec432bff7ebf994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:29:38Z,use_quota=True,user_id='4a50666f54f8450fbbacf89223a08017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Creating volume e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:29:38 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:29:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:38 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 1073741824 Sep 30 22:29:38 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:39 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 1073741824" returned: 0 in 0.449s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:39 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 Sep 30 22:29:39 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:39 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62" returned: 0 in 0.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71fdd5c-5625-49f4-87ca-3ac8fb787b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f13cf9-8323-439f-a332-e607a84a3b62', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ed8947-0119-4c93-b156-f37a607eadb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Volume volume-e5f13cf9-8323-439f-a332-e607a84a3b62 (e5f13cf9-8323-439f-a332-e607a84a3b62): created successfully Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ed8947-0119-4c93-b156-f37a607eadb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Flow 'volume_create_manager' (3d92d89b-b608-46e4-9a2b-e8aa7bfac29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:29:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d5d5d158-1d0c-48ee-b40a-cbea9c3757d2 tempest-SnapshotDependencyTests-1005174916 None] Created volume successfully. Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Creating offline snapshot c198aac0-8b0c-4665-944a-80bb89ecbebf of volume e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[419fe17c-3f3d-4796-91bd-9ffb91ca7e5b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:39 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 Sep 30 22:29:39 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:40 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62" returned: 0 in 0.405s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:40 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf 1G Sep 30 22:29:40 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:40 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf 1G" returned: 0 in 0.421s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f13cf9-8323-439f-a332-e607a84a3b62 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:40 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f13cf9-8323-439f-a332-e607a84a3b62 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf Sep 30 22:29:40 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:40 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f13cf9-8323-439f-a332-e607a84a3b62 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf" returned: 0 in 0.298s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:40 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf is being set with open permissions: ugo+rw Sep 30 22:29:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:40 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf Sep 30 22:29:40 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:41 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf" returned: 0 in 0.263s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:41 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.info Sep 30 22:29:41 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:41 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.info" returned: 0 in 0.263s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:41 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.info is being set with open permissions: ugo+rw Sep 30 22:29:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:41 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.info Sep 30 22:29:41 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:41 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.info" returned: 0 in 0.274s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5450bb12-d6c7-4b9c-9c13-63ee9ab81225 tempest-SnapshotDependencyTests-1005174916 None] Create snapshot completed successfully Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Flow 'volume_create_manager' (33f4fe77-7b4c-46d6-a8f1-62be5764d442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690cec0c-3b73-428a-9531-2f3c80610de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690cec0c-3b73-428a-9531-2f3c80610de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4610f82d-ea68-48b1-84c8-492f760dd339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ef0c4ece7a4e10bec432bff7ebf994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c198aac0-8b0c-4665-944a-80bb89ecbebf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:29:43Z,use_quota=True,user_id='4a50666f54f8450fbbacf89223a08017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023a833a-5537-46e9-b952-1591b659080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023a833a-5537-46e9-b952-1591b659080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6a8dab-b1d2-426f-857b-22139835bcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6a8dab-b1d2-426f-857b-22139835bcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4610f82d-ea68-48b1-84c8-492f760dd339', 'volume_name': 'volume-4610f82d-ea68-48b1-84c8-492f760dd339', 'volume_size': 1, 'snapshot_id': 'c198aac0-8b0c-4665-944a-80bb89ecbebf'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ac5c8a-3a44-4bfb-af4c-c1d33800710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ac5c8a-3a44-4bfb-af4c-c1d33800710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02c3799-fc54-4304-856b-ad033e99e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:43 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Volume 4610f82d-ea68-48b1-84c8-492f760dd339: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4610f82d-ea68-48b1-84c8-492f760dd339', 'volume_size': 1, 'snapshot_id': 'c198aac0-8b0c-4665-944a-80bb89ecbebf'} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "cinder-quobyte-c198aac0-8b0c-4665-944a-80bb89ecbebf-4610f82d-ea68-48b1-84c8-492f760dd339" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-c198aac0-8b0c-4665-944a-80bb89ecbebf-4610f82d-ea68-48b1-84c8-492f760dd339" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Creating volume 4610f82d-ea68-48b1-84c8-492f760dd339 from snapshot c198aac0-8b0c-4665-944a-80bb89ecbebf {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "cinder-quobyte-4610f82d-ea68-48b1-84c8-492f760dd339" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-4610f82d-ea68-48b1-84c8-492f760dd339" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] snapshot: c198aac0-8b0c-4665-944a-80bb89ecbebf, volume: 4610f82d-ea68-48b1-84c8-492f760dd339, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd80445c-30e4-4bc5-8f0f-e2a67e71e312]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:43 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf Sep 30 22:29:43 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:44 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf" returned: 0 in 0.384s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5f13cf9-8323-439f-a332-e607a84a3b62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:29:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dddd27-1eac-419c-aaca-6d898a10d642]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:44 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 Sep 30 22:29:44 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:44 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62" returned: 0 in 0.375s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:29:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:29:44 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:29:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:44 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 Sep 30 22:29:44 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Flow 'volume_create_manager' (31efe597-ab34-46f7-b904-1a8c9c389e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e8b001-b3c7-4a08-a8c0-a2148f073f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e8b001-b3c7-4a08-a8c0-a2148f073f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1292683781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11bb44d-f347-4bd0-89f1-539326595e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe5b52cc0544f94a4be526dab4d48fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:29:45Z,use_quota=True,user_id='80e19f4f10ed477597fcd41ace1bac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df88eb4-9d2d-40d6-8f1c-ba0463e6e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df88eb4-9d2d-40d6-8f1c-ba0463e6e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a07d21-e943-45bf-809c-17dcd5f83a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a07d21-e943-45bf-809c-17dcd5f83a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11bb44d-f347-4bd0-89f1-539326595e20', 'volume_name': 'volume-a11bb44d-f347-4bd0-89f1-539326595e20', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deba9f63-6f6a-4d75-ac2c-c07e968d935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deba9f63-6f6a-4d75-ac2c-c07e968d935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f165e35b-f8ac-4442-9557-4d408d94e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:45 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Volume a11bb44d-f347-4bd0-89f1-539326595e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11bb44d-f347-4bd0-89f1-539326595e20', 'volume_size': 1} Sep 30 22:29:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:50 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339" returned: 0 in 6.121s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:29:50 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Converted 1024.00 MB image at 167.25 MB/s Sep 30 22:29:50 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 is being set with open permissions: ugo+rw Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:50 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 Sep 30 22:29:50 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:50 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-4610f82d-ea68-48b1-84c8-492f760dd339" released by "_copy_volume_from_snapshot" :: held 7.213s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-c198aac0-8b0c-4665-944a-80bb89ecbebf-4610f82d-ea68-48b1-84c8-492f760dd339" released by "_create_volume_from_snapshot" :: held 7.276s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.301s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.517s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1292683781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11bb44d-f347-4bd0-89f1-539326595e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe5b52cc0544f94a4be526dab4d48fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:29:45Z,use_quota=True,user_id='80e19f4f10ed477597fcd41ace1bac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Creating volume a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:29:50 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:50 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 1073741824 Sep 30 22:29:50 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02c3799-fc54-4304-856b-ad033e99e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4610f82d-ea68-48b1-84c8-492f760dd339', 'volume_size': 1, 'snapshot_id': 'c198aac0-8b0c-4665-944a-80bb89ecbebf'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c18b0c-7cec-40cf-9dc1-2fb65e41ee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Volume volume-4610f82d-ea68-48b1-84c8-492f760dd339 (4610f82d-ea68-48b1-84c8-492f760dd339): created successfully Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c18b0c-7cec-40cf-9dc1-2fb65e41ee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Flow 'volume_create_manager' (33f4fe77-7b4c-46d6-a8f1-62be5764d442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:29:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-251c01e8-debf-427a-b469-a6588e79d27d tempest-SnapshotDependencyTests-1005174916 None] Created volume successfully. Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "cinder-c198aac0-8b0c-4665-944a-80bb89ecbebf-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-c198aac0-8b0c-4665-944a-80bb89ecbebf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "cinder-quobyte-e5f13cf9-8323-439f-a332-e607a84a3b62" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-e5f13cf9-8323-439f-a332-e607a84a3b62" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "cinder-quobyte-c198aac0-8b0c-4665-944a-80bb89ecbebf" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-c198aac0-8b0c-4665-944a-80bb89ecbebf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Deleting offline snapshot c198aac0-8b0c-4665-944a-80bb89ecbebf of volume e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] snapshot_file for this snap is: volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[955b0883-075d-4d72-82df-42f9c9f544de]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:51 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 1073741824" returned: 0 in 0.451s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:51 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf Sep 30 22:29:51 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:51 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 Sep 30 22:29:51 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:51 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf" returned: 0 in 0.381s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5f13cf9-8323-439f-a332-e607a84a3b62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:29:51 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20" returned: 0 in 0.268s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4bf57d-c2a5-41de-b443-2e71152f8cdb]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f165e35b-f8ac-4442-9557-4d408d94e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11bb44d-f347-4bd0-89f1-539326595e20', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279bb547-5809-4d5d-a037-0ef37dffa8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:29:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Volume volume-a11bb44d-f347-4bd0-89f1-539326595e20 (a11bb44d-f347-4bd0-89f1-539326595e20): created successfully Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279bb547-5809-4d5d-a037-0ef37dffa8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:29:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Flow 'volume_create_manager' (31efe597-ab34-46f7-b904-1a8c9c389e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:29:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6957cb2b-1bdf-4693-81a9-5b6aa0409cf7 tempest-VolumesDeleteCascade-1781684385 None] Created volume successfully. Sep 30 22:29:51 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 Sep 30 22:29:51 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:52 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62" returned: 0 in 0.534s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:52 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf Sep 30 22:29:52 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:52 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf" returned: 0 in 0.323s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:52 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf Sep 30 22:29:52 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:52 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62.c198aac0-8b0c-4665-944a-80bb89ecbebf" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-c198aac0-8b0c-4665-944a-80bb89ecbebf" released by "_delete_snapshot" :: held 1.607s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-e5f13cf9-8323-439f-a332-e607a84a3b62" released by "delete_snapshot" :: held 1.630s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Created reservations ['85fb7f37-6f95-4d81-a7a5-866127a14d3e', 'e8db4c4b-fa4e-4785-80b9-7227429c93c3', '0ed5efb1-4257-4eb2-bf96-be47f06c28b7', 'd64f8622-9518-4e43-881a-96904eab57bf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Delete snapshot completed successfully. Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Creating offline snapshot 17d165f6-e5d9-40f0-92dd-1e42c10288fe of volume a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e9c47604-e8b7-4b31-bafb-36ea2540d1ad tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-c198aac0-8b0c-4665-944a-80bb89ecbebf-delete_snapshot" released by "delete_snapshot" :: held 1.818s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[39af28e5-6939-4359-a66b-14cfc066a5d9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:53 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 Sep 30 22:29:53 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "cinder-e5f13cf9-8323-439f-a332-e607a84a3b62-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-e5f13cf9-8323-439f-a332-e607a84a3b62-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:53 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20" returned: 0 in 0.371s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:53 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe 1G Sep 30 22:29:53 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "cinder-quobyte-e5f13cf9-8323-439f-a332-e607a84a3b62" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-e5f13cf9-8323-439f-a332-e607a84a3b62" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e32c17-67af-4865-9ebf-4df57f6b9de4]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:53 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 Sep 30 22:29:53 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:53 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe 1G" returned: 0 in 0.397s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11bb44d-f347-4bd0-89f1-539326595e20 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:53 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11bb44d-f347-4bd0-89f1-539326595e20 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe Sep 30 22:29:53 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:53 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62" returned: 0 in 0.381s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:53 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62 Sep 30 22:29:53 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:54 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11bb44d-f347-4bd0-89f1-539326595e20 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe" returned: 0 in 0.304s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:54 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe is being set with open permissions: ugo+rw Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:54 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe Sep 30 22:29:54 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:54 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e5f13cf9-8323-439f-a332-e607a84a3b62" returned: 0 in 0.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-e5f13cf9-8323-439f-a332-e607a84a3b62" released by "delete_volume" :: held 0.704s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Created reservations ['358e38d0-4222-417e-9f67-f2a00c8e4e16', 'b9d96f47-5466-4e6e-bd20-3a6e3b945b1b', '7ba671ba-8a9f-482f-9ee6-fba2094a9ab9', '282e8031-e14b-428a-9356-1e3977fb2ad2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:54 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:29:54 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:54 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:54 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.info Sep 30 22:29:54 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "cinder-4610f82d-ea68-48b1-84c8-492f760dd339-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:54 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-4610f82d-ea68-48b1-84c8-492f760dd339-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:29:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Deleted volume successfully. Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-593da547-e154-4318-895d-d3c1185bf208 tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-e5f13cf9-8323-439f-a332-e607a84a3b62-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "cinder-quobyte-4610f82d-ea68-48b1-84c8-492f760dd339" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-4610f82d-ea68-48b1-84c8-492f760dd339" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509fe9c-8ff0-44ae-8303-8f841b7ee6e5]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:54 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.info" returned: 0 in 0.304s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:54 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.info is being set with open permissions: ugo+rw Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:54 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.info Sep 30 22:29:54 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:54 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 Sep 30 22:29:54 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:54 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.info" returned: 0 in 0.258s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8d6d329b-b6f3-4218-b9ae-979e3361d890 tempest-VolumesDeleteCascade-1781684385 None] Create snapshot completed successfully Sep 30 22:29:55 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339" returned: 0 in 0.354s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:55 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339 Sep 30 22:29:55 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Creating offline snapshot d8528e2d-9b12-4808-b273-2cb0d8ad91e1 of volume a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:29:55 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4610f82d-ea68-48b1-84c8-492f760dd339" returned: 0 in 0.297s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ab9d87-d360-4a54-9047-8cffa142dcde]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-quobyte-4610f82d-ea68-48b1-84c8-492f760dd339" released by "delete_volume" :: held 0.705s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Created reservations ['57daae2b-4b7c-46c2-a344-734b1742e967', '12a070d2-0320-430b-a828-dd2e4977dbba', '50375df8-5a10-4552-9f4b-4280f1b87a64', '5e6c6547-1c79-4151-aece-a2ed9555d00e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:29:55 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe Sep 30 22:29:55 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:55 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:29:55 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:55 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.260s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:29:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Deleted volume successfully. Sep 30 22:29:55 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe" returned: 0 in 0.402s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a11bb44d-f347-4bd0-89f1-539326595e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:55 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 1G Sep 30 22:29:55 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1918968d-ec26-40ee-abd9-d7d2accfdbaa tempest-SnapshotDependencyTests-1005174916 None] Lock "cinder-4610f82d-ea68-48b1-84c8-492f760dd339-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:29:56 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 1G" returned: 0 in 0.439s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:56 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 Sep 30 22:29:56 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:56 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1" returned: 0 in 0.344s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:56 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 is being set with open permissions: ugo+rw Sep 30 22:29:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:56 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 Sep 30 22:29:56 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:56 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.536s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:29:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ba69e012-339f-487d-b337-84ac12cf5654 tempest-VolumesDeleteCascade-1781684385 None] Create snapshot completed successfully Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-a11bb44d-f347-4bd0-89f1-539326595e20-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-a11bb44d-f347-4bd0-89f1-539326595e20-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Performing cascade delete. {{(pid=87240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-17d165f6-e5d9-40f0-92dd-1e42c10288fe-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-17d165f6-e5d9-40f0-92dd-1e42c10288fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-a11bb44d-f347-4bd0-89f1-539326595e20" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-a11bb44d-f347-4bd0-89f1-539326595e20" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-17d165f6-e5d9-40f0-92dd-1e42c10288fe" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-17d165f6-e5d9-40f0-92dd-1e42c10288fe" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Deleting offline snapshot 17d165f6-e5d9-40f0-92dd-1e42c10288fe of volume a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] snapshot_file for this snap is: volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb2c80f-dfad-4f50-843a-69dc0990a96a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:57 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe Sep 30 22:29:57 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:57 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe" returned: 0 in 0.373s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a11bb44d-f347-4bd0-89f1-539326595e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:29:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7303df-5a18-462f-a377-3c5110345845]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:58 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 Sep 30 22:29:58 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:58 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20" returned: 0 in 0.377s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5298f2-7c77-4cb2-9450-1d7ceb26c0d2]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:58 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 Sep 30 22:29:58 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:58 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1" returned: 0 in 0.378s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a11bb44d-f347-4bd0-89f1-539326595e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:29:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[160ba474-2830-44c7-81c1-a321bf759787]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:58 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe Sep 30 22:29:58 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:59 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe" returned: 0 in 0.443s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a11bb44d-f347-4bd0-89f1-539326595e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:29:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ef607-fc0e-4805-8a3a-1f4b76941927]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:29:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:59 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 Sep 30 22:29:59 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:29:59 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 30 22:29:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20" returned: 0 in 0.400s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:29:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:29:59 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe Sep 30 22:29:59 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:00 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe" returned: 0 in 0.362s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:00 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe Sep 30 22:30:00 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:00 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.17d165f6-e5d9-40f0-92dd-1e42c10288fe" returned: 0 in 0.239s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11bb44d-f347-4bd0-89f1-539326595e20 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 -F qcow2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:00 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11bb44d-f347-4bd0-89f1-539326595e20 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 -F qcow2 Sep 30 22:30:00 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:00 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a11bb44d-f347-4bd0-89f1-539326595e20 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 -F qcow2" returned: 0 in 0.310s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-17d165f6-e5d9-40f0-92dd-1e42c10288fe" released by "_delete_snapshot" :: held 3.073s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-a11bb44d-f347-4bd0-89f1-539326595e20" released by "delete_snapshot" :: held 3.097s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Created reservations ['139e5560-0c75-48b9-9f70-89df921a7be9', '32213e13-ab91-4b87-a0eb-e04b63269172', 'a03d3eb2-477d-441a-a446-9b31f5bc5c71', '811d1a3c-5605-487c-9de7-ea285d3498cf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Delete snapshot completed successfully. Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-17d165f6-e5d9-40f0-92dd-1e42c10288fe-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-d8528e2d-9b12-4808-b273-2cb0d8ad91e1-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-d8528e2d-9b12-4808-b273-2cb0d8ad91e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-a11bb44d-f347-4bd0-89f1-539326595e20" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-a11bb44d-f347-4bd0-89f1-539326595e20" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-d8528e2d-9b12-4808-b273-2cb0d8ad91e1" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-d8528e2d-9b12-4808-b273-2cb0d8ad91e1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Deleting offline snapshot d8528e2d-9b12-4808-b273-2cb0d8ad91e1 of volume a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] snapshot_file for this snap is: volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae4b8f5-5c95-4b61-b05c-3ea55521a65b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:00 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 Sep 30 22:30:00 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:01 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1" returned: 0 in 0.410s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a11bb44d-f347-4bd0-89f1-539326595e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:30:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b32534c-0f6c-4b56-a29c-1149ac3fe10f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:01 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 Sep 30 22:30:01 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:01 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20" returned: 0 in 0.364s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:01 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 Sep 30 22:30:01 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:02 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:02 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1 Sep 30 22:30:02 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:02 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20.d8528e2d-9b12-4808-b273-2cb0d8ad91e1" returned: 0 in 0.263s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-d8528e2d-9b12-4808-b273-2cb0d8ad91e1" released by "_delete_snapshot" :: held 1.508s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-a11bb44d-f347-4bd0-89f1-539326595e20" released by "delete_snapshot" :: held 1.531s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Created reservations ['df9b3465-88fe-4e9a-8382-a62442ad8809', 'f090c4e5-3ee2-4064-9950-12685088f8a1', '90ac8f5d-d2fe-4bf6-898f-c259522f715e', 'e374e9ba-eb5c-4a02-a43e-4965d0723dc3'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Delete snapshot completed successfully. Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-d8528e2d-9b12-4808-b273-2cb0d8ad91e1-delete_snapshot" released by "delete_snapshot" :: held 1.666s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Snapshots deleted, issuing volume delete {{(pid=87240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-a11bb44d-f347-4bd0-89f1-539326595e20" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-a11bb44d-f347-4bd0-89f1-539326595e20" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9803232-c9ba-47f5-a68f-be1ad88bec2b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:02 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 Sep 30 22:30:02 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:02 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20" returned: 0 in 0.372s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:02 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20 Sep 30 22:30:02 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:03 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a11bb44d-f347-4bd0-89f1-539326595e20" returned: 0 in 0.299s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:03 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:03 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-a11bb44d-f347-4bd0-89f1-539326595e20" released by "delete_volume" :: held 0.751s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Created reservations ['2fd07456-9672-4088-9a1e-a94866371b23', 'd24a7c02-b3c3-4775-b9ef-e840f1e27298', 'd054ef1c-7eea-43c5-b4da-6bc8fa24b0f3', '6980becf-a124-48ad-9d02-0fd9a5fc4129'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:03 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:03 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:03 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.284s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:30:03 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.266s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Deleted volume successfully. Sep 30 22:30:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9831fc2b-e00c-4996-aab7-694f01ec71d2 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-a11bb44d-f347-4bd0-89f1-539326595e20-delete_volume" released by "delete_volume" :: held 6.189s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Flow 'volume_create_manager' (6f4e438d-4abb-4c16-84dd-83544a8e6056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e728e-e964-4b0e-b0a6-b64961999496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e728e-e964-4b0e-b0a6-b64961999496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1644467931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe5b52cc0544f94a4be526dab4d48fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:05Z,use_quota=True,user_id='80e19f4f10ed477597fcd41ace1bac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65dd1f64-f0c3-4188-aa7f-e3280867d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65dd1f64-f0c3-4188-aa7f-e3280867d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9cc902-2459-4a97-a325-f668cba630b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9cc902-2459-4a97-a325-f668cba630b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb', 'volume_name': 'volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb397c2-d71c-40ac-a34a-b876fef78544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb397c2-d71c-40ac-a34a-b876fef78544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e92bb5-aa88-4e34-883b-f57e771525e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Volume 938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb', 'volume_size': 1} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1644467931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe5b52cc0544f94a4be526dab4d48fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:05Z,use_quota=True,user_id='80e19f4f10ed477597fcd41ace1bac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Creating volume 938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:30:04 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:30:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:04 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb 1073741824 Sep 30 22:30:04 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:05 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb 1073741824" returned: 0 in 0.448s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:05 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb Sep 30 22:30:05 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:05 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" returned: 0 in 0.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e92bb5-aa88-4e34-883b-f57e771525e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2579352d-3b33-4735-bdaa-ecc2b222b59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Volume volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb (938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb): created successfully Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2579352d-3b33-4735-bdaa-ecc2b222b59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Flow 'volume_create_manager' (6f4e438d-4abb-4c16-84dd-83544a8e6056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fcc544c0-b703-4a5d-a809-ce5961dbab5d tempest-VolumesDeleteCascade-1781684385 None] Created volume successfully. Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Creating offline snapshot d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d of volume 938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9aa21e-c1d0-46c2-8ca1-973a50a90671]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:05 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb Sep 30 22:30:05 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:06 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" returned: 0 in 0.367s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:06 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d 1G Sep 30 22:30:06 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:06 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d 1G" returned: 0 in 0.386s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:06 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d Sep 30 22:30:06 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:06 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d" returned: 0 in 0.293s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:06 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d is being set with open permissions: ugo+rw Sep 30 22:30:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:06 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d Sep 30 22:30:06 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:07 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:07 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.info Sep 30 22:30:07 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:07 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.info" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:07 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.info is being set with open permissions: ugo+rw Sep 30 22:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:07 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.info Sep 30 22:30:07 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:07 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.info" returned: 0 in 0.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-edcc6bdc-1384-41e7-a327-c8991ab02f7a tempest-VolumesDeleteCascade-1781684385 None] Create snapshot completed successfully Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Flow 'volume_create_manager' (f2230bd4-433c-47de-8ae5-e69ba4484f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866c19db-ec74-4be4-8053-9f63a6b90697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866c19db-ec74-4be4-8053-9f63a6b90697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1398533080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31932dcc-1c28-4b96-ac54-7fbbcb4c77c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe5b52cc0544f94a4be526dab4d48fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:08Z,use_quota=True,user_id='80e19f4f10ed477597fcd41ace1bac58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0168abf-3a6b-444e-b0af-ddc6c8dd66d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0168abf-3a6b-444e-b0af-ddc6c8dd66d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de3a00e-f797-444e-9a27-a00e0eee7668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de3a00e-f797-444e-9a27-a00e0eee7668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31932dcc-1c28-4b96-ac54-7fbbcb4c77c7', 'volume_name': 'volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7', 'volume_size': 1, 'snapshot_id': 'd9dcc6b3-c9d4-4e57-9c8d-58288ff5949d'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbbeb74-393b-453b-84be-024a3ff9c883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbbeb74-393b-453b-84be-024a3ff9c883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa638b2-7d27-4de4-b5e9-7e98f503114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Volume 31932dcc-1c28-4b96-ac54-7fbbcb4c77c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7', 'volume_size': 1, 'snapshot_id': 'd9dcc6b3-c9d4-4e57-9c8d-58288ff5949d'} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Creating volume 31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 from snapshot d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] snapshot: d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d, volume: 31932dcc-1c28-4b96-ac54-7fbbcb4c77c7, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6dcd21-2fb1-4db0-b8bc-294e236835a3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:08 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d Sep 30 22:30:08 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:08 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d" returned: 0 in 0.350s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b73093-5518-453b-ae29-5305f8bb2321]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:09 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb Sep 30 22:30:09 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:09 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" returned: 0 in 0.350s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:30:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:30:09 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:30:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:09 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 Sep 30 22:30:09 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:15 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" returned: 0 in 5.879s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:30:15 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Converted 1024.00 MB image at 174.12 MB/s Sep 30 22:30:15 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 is being set with open permissions: ugo+rw Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:15 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 Sep 30 22:30:15 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:15 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" returned: 0 in 0.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" released by "_copy_volume_from_snapshot" :: held 6.897s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" released by "_create_volume_from_snapshot" :: held 6.951s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.966s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa638b2-7d27-4de4-b5e9-7e98f503114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7', 'volume_size': 1, 'snapshot_id': 'd9dcc6b3-c9d4-4e57-9c8d-58288ff5949d'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f74fec6-8789-4a40-b9bc-b3dea0682730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Volume volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 (31932dcc-1c28-4b96-ac54-7fbbcb4c77c7): created successfully Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f74fec6-8789-4a40-b9bc-b3dea0682730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Flow 'volume_create_manager' (f2230bd4-433c-47de-8ae5-e69ba4484f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2bcd2f1a-805b-4351-9969-4bcdaf9f764f tempest-VolumesDeleteCascade-1781684385 None] Created volume successfully. Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Performing cascade delete. {{(pid=87240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Deleting offline snapshot d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d of volume 938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] snapshot_file for this snap is: volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[da356dcb-c9ae-4517-bba2-3b8d144ec90a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:16 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d Sep 30 22:30:16 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:16 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d" returned: 0 in 0.344s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d30ec-7568-4bdf-b725-cc5e1d0816c9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:16 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb Sep 30 22:30:16 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:17 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" returned: 0 in 0.548s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:17 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d Sep 30 22:30:17 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:17 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d" returned: 0 in 0.325s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:17 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d Sep 30 22:30:17 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:17 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb.d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d" returned: 0 in 0.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d" released by "_delete_snapshot" :: held 1.544s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" released by "delete_snapshot" :: held 1.564s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Created reservations ['0f546a3d-619f-4cc1-98d8-66d664a00e06', 'fc695668-38d7-415f-addc-6dd3f52b9a92', '795e085f-14f2-4b83-9918-04070eaaa565', 'fe1e8cee-d4c1-4a01-bcab-f48f556738c7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Delete snapshot completed successfully. Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-d9dcc6b3-c9d4-4e57-9c8d-58288ff5949d-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Snapshots deleted, issuing volume delete {{(pid=87240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1523069b-750f-4cc1-a156-23ead74aaa76]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:17 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb Sep 30 22:30:17 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:18 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" returned: 0 in 0.359s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:18 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb Sep 30 22:30:18 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:18 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" returned: 0 in 0.238s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb" released by "delete_volume" :: held 0.655s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Created reservations ['68a5de08-f601-42df-a5a3-7e724513a4a3', 'f1a21c2a-c71c-4324-80d6-63cb7c757725', '0f2de730-34a0-4a4f-8336-2c0121204bef', '7c45bccc-2b4b-4c9e-85db-4aa4e4363d29'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:18 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:18 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:18 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.233s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Deleted volume successfully. Sep 30 22:30:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7500a41e-9b5a-4e89-9191-71c333dd31cf tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-938b5bb0-1eb6-43bd-92d8-9bf09e6b3bbb-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "cinder-quobyte-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4117d14e-bd9a-469c-92c1-1d0a0cab6a4e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:19 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 Sep 30 22:30:19 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:19 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:19 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7 Sep 30 22:30:19 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:20 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" returned: 0 in 0.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-quobyte-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7" released by "delete_volume" :: held 0.640s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Created reservations ['2a0c4336-ab25-46b2-a489-4543109aca66', 'cad8be5e-45bd-4601-b260-2727abbba912', 'e6c2c860-aa1f-496b-9f87-a82672ad8b96', '82d493b5-713f-40c1-812b-239a97638bdf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:20 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:20 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:20 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Deleted volume successfully. Sep 30 22:30:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-88237faf-0e13-4364-b80e-775e3dcf59f6 tempest-VolumesDeleteCascade-1781684385 None] Lock "cinder-31932dcc-1c28-4b96-ac54-7fbbcb4c77c7-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (e6a0606c-da74-4269-bb1f-9a058dac4f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2babcc39-ce27-4300-ad41-5fa031cdce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2babcc39-ce27-4300-ad41-5fa031cdce2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1369780936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0f8fb8-751c-441b-ac54-f1af7742d378,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:24Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa50dd6-7cce-46c7-b2bd-f365dc691fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa50dd6-7cce-46c7-b2bd-f365dc691fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79a5771-3759-4c43-8cdb-f11c56aed52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79a5771-3759-4c43-8cdb-f11c56aed52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0f8fb8-751c-441b-ac54-f1af7742d378', 'volume_name': 'volume-8f0f8fb8-751c-441b-ac54-f1af7742d378', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad76e8e-e41c-403e-98b6-8266d498fff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad76e8e-e41c-403e-98b6-8266d498fff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9a9014-81e5-4259-9944-5c1ddb23665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:24 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Volume 8f0f8fb8-751c-441b-ac54-f1af7742d378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0f8fb8-751c-441b-ac54-f1af7742d378', 'volume_size': 1} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1369780936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0f8fb8-751c-441b-ac54-f1af7742d378,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:24Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Creating volume 8f0f8fb8-751c-441b-ac54-f1af7742d378 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:30:24 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:24 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 1073741824 Sep 30 22:30:24 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:24 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 1073741824" returned: 0 in 0.404s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:24 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 Sep 30 22:30:24 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:24 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9a9014-81e5-4259-9944-5c1ddb23665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0f8fb8-751c-441b-ac54-f1af7742d378', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc66d6c-681e-4306-a998-596d2a3edbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:24 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Volume volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 (8f0f8fb8-751c-441b-ac54-f1af7742d378): created successfully Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc66d6c-681e-4306-a998-596d2a3edbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (e6a0606c-da74-4269-bb1f-9a058dac4f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-77c5e782-bd43-44df-abde-2e84fd5bf0b0 tempest-VolumesGetTest-1532444045 None] Created volume successfully. Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (65f7d98f-b88a-43a3-920b-0b8f10e8e0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa4cb94-4518-499f-aa88-a732cbc2e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa4cb94-4518-499f-aa88-a732cbc2e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1229863308',display_name='tempest-VolumesGetTest-Volume-1368768487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ed5a92-e15b-48be-840a-fe8af338b430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:26Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11190d6-956d-4f20-a666-af1b67a4e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11190d6-956d-4f20-a666-af1b67a4e75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c23d4c-ebc1-480b-8de8-83c40fa36ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c23d4c-ebc1-480b-8de8-83c40fa36ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ed5a92-e15b-48be-840a-fe8af338b430', 'volume_name': 'volume-55ed5a92-e15b-48be-840a-fe8af338b430', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a50c1c-555b-4254-b740-f1aa70b149a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a50c1c-555b-4254-b740-f1aa70b149a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0425eb7-55f1-4586-a9bc-763fe60e6ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Volume 55ed5a92-e15b-48be-840a-fe8af338b430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ed5a92-e15b-48be-840a-fe8af338b430', 'volume_size': 1} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1229863308',display_name='tempest-VolumesGetTest-Volume-1368768487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ed5a92-e15b-48be-840a-fe8af338b430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:26Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Creating volume 55ed5a92-e15b-48be-840a-fe8af338b430 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:30:25 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:30:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:25 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430 1073741824 Sep 30 22:30:25 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:26 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430 1073741824" returned: 0 in 0.403s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:26 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430 Sep 30 22:30:26 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:26 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0425eb7-55f1-4586-a9bc-763fe60e6ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ed5a92-e15b-48be-840a-fe8af338b430', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f78d5c6-b569-426e-b7d7-9d2df87b5456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Volume volume-55ed5a92-e15b-48be-840a-fe8af338b430 (55ed5a92-e15b-48be-840a-fe8af338b430): created successfully Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f78d5c6-b569-426e-b7d7-9d2df87b5456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (65f7d98f-b88a-43a3-920b-0b8f10e8e0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3c19e9a3-1854-4690-9421-a2b21e75e250 tempest-VolumesGetTest-1532444045 None] Created volume successfully. Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-55ed5a92-e15b-48be-840a-fe8af338b430-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Lock "cinder-55ed5a92-e15b-48be-840a-fe8af338b430-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-quobyte-55ed5a92-e15b-48be-840a-fe8af338b430" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-55ed5a92-e15b-48be-840a-fe8af338b430" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec7a646-a776-4632-8028-aeea7e8452d2]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:27 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430 Sep 30 22:30:27 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:27 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:27 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430 Sep 30 22:30:27 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:27 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-55ed5a92-e15b-48be-840a-fe8af338b430" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-55ed5a92-e15b-48be-840a-fe8af338b430" released by "delete_volume" :: held 0.640s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Created reservations ['74bdce41-9359-4ae5-b49d-faf11c5ca3d9', 'fc00bb43-231c-4e0a-a8ce-cdb1c557d814', '11dc8ff0-ebc4-469d-b4ec-902e8032ecba', '6bd8a05a-b953-44de-8cf2-117d09284571'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:27 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:27 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:28 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.267s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Deleted volume successfully. Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-46b34c6a-df69-46b8-84c2-860f32c52153 tempest-VolumesGetTest-1532444045 None] Lock "cinder-55ed5a92-e15b-48be-840a-fe8af338b430-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-8f0f8fb8-751c-441b-ac54-f1af7742d378-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Lock "cinder-8f0f8fb8-751c-441b-ac54-f1af7742d378-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-quobyte-8f0f8fb8-751c-441b-ac54-f1af7742d378" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-8f0f8fb8-751c-441b-ac54-f1af7742d378" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6d5e62-1d7e-429e-b246-953de5c8ab26]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:28 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 Sep 30 22:30:28 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:28 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378" returned: 0 in 0.354s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:28 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378 Sep 30 22:30:28 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:28 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8f0f8fb8-751c-441b-ac54-f1af7742d378" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-8f0f8fb8-751c-441b-ac54-f1af7742d378" released by "delete_volume" :: held 0.634s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Created reservations ['eb162037-eb3e-4fb6-87af-f3ab767eb37b', '1cfc01f4-55f9-49dd-8de4-2f316b7fba8e', '1457512b-0bd3-47be-ac74-f5d75f5e8dae', 'a5ee7f4f-9d81-4d47-9d26-f05b07a05191'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:28 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:28 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:29 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Deleted volume successfully. Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-165dd906-a71e-48d9-88c4-ab543c794812 tempest-VolumesGetTest-1532444045 None] Lock "cinder-8f0f8fb8-751c-441b-ac54-f1af7742d378-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (88d27696-08d7-4a5c-9838-b30aa9e6f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe15a0-6d61-4d86-87a3-a0565fbcf5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe15a0-6d61-4d86-87a3-a0565fbcf5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-832160548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abaa046-e1e9-498d-a8de-6e8fea9aebd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:30Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a126ee-d6ec-4283-9021-6e29336f53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a126ee-d6ec-4283-9021-6e29336f53d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d12f24-7b58-4460-a96c-4a4401973f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d12f24-7b58-4460-a96c-4a4401973f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4abaa046-e1e9-498d-a8de-6e8fea9aebd5', 'volume_name': 'volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990b71c4-1a39-4cae-a1f6-0bf619f09bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990b71c4-1a39-4cae-a1f6-0bf619f09bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf8f3f2-3d9b-49f5-a699-d606fde47f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Volume 4abaa046-e1e9-498d-a8de-6e8fea9aebd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5', 'volume_size': 1} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-832160548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4abaa046-e1e9-498d-a8de-6e8fea9aebd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:30Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Creating volume 4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:30:29 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:30:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:29 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 1073741824 Sep 30 22:30:29 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:30 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 1073741824" returned: 0 in 0.406s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:30 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 Sep 30 22:30:30 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:30 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5" returned: 0 in 0.238s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:30:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf8f3f2-3d9b-49f5-a699-d606fde47f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a1aa89-9775-43ec-9c9f-06c5f42c47ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Volume volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 (4abaa046-e1e9-498d-a8de-6e8fea9aebd5): created successfully Sep 30 22:30:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a1aa89-9775-43ec-9c9f-06c5f42c47ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (88d27696-08d7-4a5c-9838-b30aa9e6f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b942fa6d-e176-406e-baba-3199b0bea496 tempest-VolumesGetTest-1532444045 None] Created volume successfully. Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (b703b54a-7847-4425-aeea-c3bd355d8698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922e6a40-6e72-41c9-a13b-2381ffaceef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922e6a40-6e72-41c9-a13b-2381ffaceef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-148329467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0615c46-a2a3-47c6-9538-dd66773bc1fb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4abaa046-e1e9-498d-a8de-6e8fea9aebd5,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:31Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3fc817-d953-4628-8149-5d520778b266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3fc817-d953-4628-8149-5d520778b266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d649c99e-937e-489c-a489-943af162a436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d649c99e-937e-489c-a489-943af162a436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c0615c46-a2a3-47c6-9538-dd66773bc1fb', 'volume_name': 'volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb', 'volume_size': 1, 'source_volid': '4abaa046-e1e9-498d-a8de-6e8fea9aebd5', 'source_volstatus': 'available'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13599b6d-d750-4ec7-a158-377fe0916e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13599b6d-d750-4ec7-a158-377fe0916e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6ef41a-eb89-42cd-8adb-a156193d775c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Volume c0615c46-a2a3-47c6-9538-dd66773bc1fb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb', 'volume_size': 1, 'source_volid': '4abaa046-e1e9-498d-a8de-6e8fea9aebd5', 'source_volstatus': 'available'} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:31 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Cloning volume 4abaa046-e1e9-498d-a8de-6e8fea9aebd5 to volume c0615c46-a2a3-47c6-9538-dd66773bc1fb Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Creating offline snapshot a7dc4e03-a93b-4859-b22f-3bace5c2ee39 of volume 4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5b701b-2a16-4fe2-adbf-b5ce27b77d37]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:31 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 Sep 30 22:30:31 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:31 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5" returned: 0 in 0.351s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:31 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 1G Sep 30 22:30:31 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:32 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 1G" returned: 0 in 0.389s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:32 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 Sep 30 22:30:32 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:32 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39" returned: 0 in 0.281s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:32 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 is being set with open permissions: ugo+rw Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:32 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 Sep 30 22:30:32 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:32 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=91,cinder:INSERT=29,cinder:UPDATE=107,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=94,cinder:UPDATE=111,cinder:DELETE=12,cinder:INSERT=27 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:32 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.info Sep 30 22:30:32 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:32 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.info" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:32 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.info is being set with open permissions: ugo+rw Sep 30 22:30:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:32 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.info Sep 30 22:30:32 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:33 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.info" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-quobyte-c0615c46-a2a3-47c6-9538-dd66773bc1fb" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-c0615c46-a2a3-47c6-9538-dd66773bc1fb" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] snapshot: a7dc4e03-a93b-4859-b22f-3bace5c2ee39, volume: c0615c46-a2a3-47c6-9538-dd66773bc1fb, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f91e118-79ec-449d-897d-70473a4a78fa]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:33 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 Sep 30 22:30:33 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:33 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39" returned: 0 in 0.354s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad5e0c-170b-4e8d-82fb-1b85062f4975]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:33 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 Sep 30 22:30:33 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:33 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5" returned: 0 in 0.346s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:30:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:34 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb Sep 30 22:30:34 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:39 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb" returned: 0 in 5.887s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:39 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:30:39 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Converted 1024.00 MB image at 173.89 MB/s Sep 30 22:30:39 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb is being set with open permissions: ugo+rw Sep 30 22:30:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:39 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb Sep 30 22:30:39 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:40 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb" returned: 0 in 0.235s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-c0615c46-a2a3-47c6-9538-dd66773bc1fb" released by "_copy_volume_from_snapshot" :: held 6.891s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-quobyte-a7dc4e03-a93b-4859-b22f-3bace5c2ee39" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-a7dc4e03-a93b-4859-b22f-3bace5c2ee39" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Deleting offline snapshot a7dc4e03-a93b-4859-b22f-3bace5c2ee39 of volume 4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] snapshot_file for this snap is: volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bce1cc-f36f-48b3-8e7f-8abb5c071012]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:40 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 Sep 30 22:30:40 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:40 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39" returned: 0 in 0.346s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae9fc1-68d4-42cb-a148-fe2ca2852725]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:40 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 Sep 30 22:30:40 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:41 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5" returned: 0 in 0.538s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:41 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 Sep 30 22:30:41 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:41 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39" returned: 0 in 0.313s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:41 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39 Sep 30 22:30:41 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:41 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5.a7dc4e03-a93b-4859-b22f-3bace5c2ee39" returned: 0 in 0.235s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-a7dc4e03-a93b-4859-b22f-3bace5c2ee39" released by "_delete_snapshot" :: held 1.523s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.344s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6ef41a-eb89-42cd-8adb-a156193d775c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb', 'volume_size': 1, 'source_volid': '4abaa046-e1e9-498d-a8de-6e8fea9aebd5', 'source_volstatus': 'available'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e35cb1-5a4d-4cdb-94cf-93de7b83a997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Volume volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb (c0615c46-a2a3-47c6-9538-dd66773bc1fb): created successfully Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e35cb1-5a4d-4cdb-94cf-93de7b83a997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (b703b54a-7847-4425-aeea-c3bd355d8698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b5c1034d-d48d-4264-aa51-f2567a635953 tempest-VolumesGetTest-1532444045 None] Created volume successfully. Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (7f1cb36d-33e7-4877-bfbf-2aafd7c2ded5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0d2179-9400-4aab-965d-a0f7c50da77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0d2179-9400-4aab-965d-a0f7c50da77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-249259226',display_name='tempest-VolumesGetTest-Volume-527033569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec968b3-8152-4ead-a15d-4fb86e468a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:43Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92637c2-0d54-4e9b-9bcd-024267f774d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92637c2-0d54-4e9b-9bcd-024267f774d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28650847-e817-43f7-8b9a-098b0df54750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28650847-e817-43f7-8b9a-098b0df54750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec968b3-8152-4ead-a15d-4fb86e468a3a', 'volume_name': 'volume-bec968b3-8152-4ead-a15d-4fb86e468a3a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18be9e1-0905-43b6-95fb-11d91eccd99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18be9e1-0905-43b6-95fb-11d91eccd99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44903f67-01d5-4989-8e07-758c7e03e073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Volume bec968b3-8152-4ead-a15d-4fb86e468a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec968b3-8152-4ead-a15d-4fb86e468a3a', 'volume_size': 1} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-249259226',display_name='tempest-VolumesGetTest-Volume-527033569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec968b3-8152-4ead-a15d-4fb86e468a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:43Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Creating volume bec968b3-8152-4ead-a15d-4fb86e468a3a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:30:42 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:30:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:42 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a 1073741824 Sep 30 22:30:42 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:43 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a 1073741824" returned: 0 in 0.402s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:43 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a Sep 30 22:30:43 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:43 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44903f67-01d5-4989-8e07-758c7e03e073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec968b3-8152-4ead-a15d-4fb86e468a3a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931ee8f7-82b5-4c45-be4c-472acbfee77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:43 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Volume volume-bec968b3-8152-4ead-a15d-4fb86e468a3a (bec968b3-8152-4ead-a15d-4fb86e468a3a): created successfully Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931ee8f7-82b5-4c45-be4c-472acbfee77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (7f1cb36d-33e7-4877-bfbf-2aafd7c2ded5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-53858871-4b03-41ba-a99c-ad5964c3717e tempest-VolumesGetTest-1532444045 None] Created volume successfully. Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-bec968b3-8152-4ead-a15d-4fb86e468a3a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Lock "cinder-bec968b3-8152-4ead-a15d-4fb86e468a3a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-quobyte-bec968b3-8152-4ead-a15d-4fb86e468a3a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-bec968b3-8152-4ead-a15d-4fb86e468a3a" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9815cd99-2bd3-40da-afb8-38c28e355718]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:43 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a Sep 30 22:30:43 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:44 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:44 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a Sep 30 22:30:44 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:44 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bec968b3-8152-4ead-a15d-4fb86e468a3a" returned: 0 in 0.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-bec968b3-8152-4ead-a15d-4fb86e468a3a" released by "delete_volume" :: held 0.641s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Created reservations ['59125f04-c9e8-4e20-b50b-b86868cf2068', '3d9a9f13-f4c4-4ac6-a24c-ed59d3094774', 'f94406b2-7f33-4f6d-b082-599d1c7652ec', '308663d9-d307-4e58-b155-6403e1b67af3'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:44 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:44 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:44 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Deleted volume successfully. Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec61cdfd-6c07-437f-8365-cd35f56e2bd1 tempest-VolumesGetTest-1532444045 None] Lock "cinder-bec968b3-8152-4ead-a15d-4fb86e468a3a-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-c0615c46-a2a3-47c6-9538-dd66773bc1fb-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Lock "cinder-c0615c46-a2a3-47c6-9538-dd66773bc1fb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-quobyte-c0615c46-a2a3-47c6-9538-dd66773bc1fb" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-c0615c46-a2a3-47c6-9538-dd66773bc1fb" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb84641-8720-494f-aa13-0945d13269f7]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:45 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb Sep 30 22:30:45 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:45 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:45 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb Sep 30 22:30:45 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:45 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c0615c46-a2a3-47c6-9538-dd66773bc1fb" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-c0615c46-a2a3-47c6-9538-dd66773bc1fb" released by "delete_volume" :: held 0.633s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Created reservations ['137e6dd7-6e54-4d88-abc1-a49ca8a430c5', 'e1fc4430-9bfc-4578-8a9f-f40b743bd8e5', 'c69f721c-77ed-4a86-bf86-42ac766f6120', '69c81417-e4ef-43ef-8e36-d9b13fccef54'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:45 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:45 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:45 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Deleted volume successfully. Sep 30 22:30:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32844afb-2f23-4f18-b63f-0982f1da6da0 tempest-VolumesGetTest-1532444045 None] Lock "cinder-c0615c46-a2a3-47c6-9538-dd66773bc1fb-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-4abaa046-e1e9-498d-a8de-6e8fea9aebd5-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Lock "cinder-4abaa046-e1e9-498d-a8de-6e8fea9aebd5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-quobyte-4abaa046-e1e9-498d-a8de-6e8fea9aebd5" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-4abaa046-e1e9-498d-a8de-6e8fea9aebd5" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e78864a-4d73-417e-8af8-c0baba0e7173]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:46 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 Sep 30 22:30:46 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:46 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5" returned: 0 in 0.346s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:46 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5 Sep 30 22:30:46 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:46 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-4abaa046-e1e9-498d-a8de-6e8fea9aebd5" returned: 0 in 0.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-4abaa046-e1e9-498d-a8de-6e8fea9aebd5" released by "delete_volume" :: held 0.642s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Created reservations ['8aa96e99-a015-4194-a0b8-dc3c0ce77639', 'd9eff989-5699-4fcf-bc37-e4785478b41a', 'ed7d313e-0314-4214-84bb-954facb43174', '040ad8ef-e90d-4178-bc42-909e09c70f25'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:46 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:46 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:47 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Deleted volume successfully. Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bf31dcd7-cc69-4a92-9ceb-63a240bd79f1 tempest-VolumesGetTest-1532444045 None] Lock "cinder-4abaa046-e1e9-498d-a8de-6e8fea9aebd5-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (fabc3d0d-ee71-4da8-82e3-96a2dd349547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a25bc7f-486f-4bc6-9ad8-93eb63018cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a25bc7f-486f-4bc6-9ad8-93eb63018cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2071572718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b360c34-e13e-4eec-93b1-05763453ba88,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:48Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8c98b6-2643-4074-ba7c-2112fa1eef60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8c98b6-2643-4074-ba7c-2112fa1eef60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60a437a-2612-42ea-9375-5c3f30763f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:47 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:30:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60a437a-2612-42ea-9375-5c3f30763f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b360c34-e13e-4eec-93b1-05763453ba88', 'volume_name': 'volume-8b360c34-e13e-4eec-93b1-05763453ba88', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911ac52c-d0c7-42cb-909a-52f059976814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911ac52c-d0c7-42cb-909a-52f059976814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08c1cb3-9ef4-42e3-871d-579ce17d2e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Volume 8b360c34-e13e-4eec-93b1-05763453ba88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b360c34-e13e-4eec-93b1-05763453ba88', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 30 22:30:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Trying to clone 8b360c34-e13e-4eec-93b1-05763453ba88 from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:30:48 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:30:48 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Image download 20.69 MB at 20.69 MB/s Sep 30 22:30:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd5408c-8c80-489c-b1c7-038bf63fd26d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:48 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD Sep 30 22:30:48 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:49 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a is fetched for user 29f354a7266a435bb76326f544da6938. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f5f9eb-03f9-4990-b5d4-6f66f853dfe4]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:49 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD Sep 30 22:30:49 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:49 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2071572718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b360c34-e13e-4eec-93b1-05763453ba88,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:48Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Creating volume 8b360c34-e13e-4eec-93b1-05763453ba88 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:30:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:49 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 1073741824 Sep 30 22:30:49 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:49 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 1073741824" returned: 0 in 0.404s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:49 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 Sep 30 22:30:49 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:50 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Attempting download of 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume 8b360c34-e13e-4eec-93b1-05763453ba88. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8da74d-d9a0-4762-863b-4d7fc03895e5]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_qf0phx71 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:50 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_qf0phx71 Sep 30 22:30:50 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:50 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_qf0phx71" returned: 0 in 0.313s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_qf0phx71 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:50 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_qf0phx71 Sep 30 22:30:50 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:50 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_qf0phx71" returned: 1 in 0.313s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_qf0phx71' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6df29a6-13ef-40c4-85fe-831439e4f02c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:50 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD Sep 30 22:30:50 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:51 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:51 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a was qcow2, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:30:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:51 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 Sep 30 22:30:51 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:52 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88" returned: 0 in 1.742s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:52 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a_2ttz3qs7devstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:30:52 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Converted 112.00 MB image at 64.23 MB/s Sep 30 22:30:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:52 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 1G Sep 30 22:30:52 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:53 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 1G" returned: 0 in 0.312s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Downloaded image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a ((None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}])) to volume 8b360c34-e13e-4eec-93b1-05763453ba88 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Temporary image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a for user 29f354a7266a435bb76326f544da6938 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Marking volume 8b360c34-e13e-4eec-93b1-05763453ba88 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Copying metadata from image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a to 8b360c34-e13e-4eec-93b1-05763453ba88. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Creating volume glance metadata for volume 8b360c34-e13e-4eec-93b1-05763453ba88 backed by image 04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08c1cb3-9ef4-42e3-871d-579ce17d2e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b360c34-e13e-4eec-93b1-05763453ba88', 'volume_size': 1, 'image_id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '104ed4a67dca43a186c48546d2dad151', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a', 'created_at': datetime.datetime(2026, 9, 30, 20, 7, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 7, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/04cf4351-fb7c-45f5-8d8f-9e2e3ceb3d0a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61af31b-48f1-4446-83b4-a7a9ac1ef0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Volume volume-8b360c34-e13e-4eec-93b1-05763453ba88 (8b360c34-e13e-4eec-93b1-05763453ba88): created successfully Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61af31b-48f1-4446-83b4-a7a9ac1ef0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (fabc3d0d-ee71-4da8-82e3-96a2dd349547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dbf8128a-9225-47a8-8610-8af83775a376 tempest-VolumesGetTest-1532444045 None] Created volume successfully. Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (436a0cad-0fb2-4425-aa9b-8d5846439246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b831021-c710-4efc-9dd1-216ba83f06ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b831021-c710-4efc-9dd1-216ba83f06ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-919385220',display_name='tempest-VolumesGetTest-Volume-161201924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5343d458-efad-4d4f-83bb-1b8663e2bbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:55Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8345737e-2f0b-4878-a0e8-98e014d89194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8345737e-2f0b-4878-a0e8-98e014d89194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9214f5-304e-443d-9f7c-2226f36f32aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9214f5-304e-443d-9f7c-2226f36f32aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5343d458-efad-4d4f-83bb-1b8663e2bbe7', 'volume_name': 'volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f1b7c4-9e9f-4559-9313-bb043a0ce4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f1b7c4-9e9f-4559-9313-bb043a0ce4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6129b56-02dd-4959-a252-284c85c720f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Volume 5343d458-efad-4d4f-83bb-1b8663e2bbe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7', 'volume_size': 1} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:30:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-919385220',display_name='tempest-VolumesGetTest-Volume-161201924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5343d458-efad-4d4f-83bb-1b8663e2bbe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38fc36afe7a14cbf9ee6dcaae4b3a055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:30:55Z,use_quota=True,user_id='29f354a7266a435bb76326f544da6938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Creating volume 5343d458-efad-4d4f-83bb-1b8663e2bbe7 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:30:54 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:30:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:54 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 1073741824 Sep 30 22:30:54 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:55 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 1073741824" returned: 0 in 0.407s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:55 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 Sep 30 22:30:55 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:55 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7" returned: 0 in 0.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6129b56-02dd-4959-a252-284c85c720f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e4c741-e863-4714-a31a-b952a811eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:30:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Volume volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 (5343d458-efad-4d4f-83bb-1b8663e2bbe7): created successfully Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e4c741-e863-4714-a31a-b952a811eae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Flow 'volume_create_manager' (436a0cad-0fb2-4425-aa9b-8d5846439246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:30:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bdc02cc7-fe70-4e41-9d8f-23349c7ed66e tempest-VolumesGetTest-1532444045 None] Created volume successfully. Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-5343d458-efad-4d4f-83bb-1b8663e2bbe7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Lock "cinder-5343d458-efad-4d4f-83bb-1b8663e2bbe7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-quobyte-5343d458-efad-4d4f-83bb-1b8663e2bbe7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-5343d458-efad-4d4f-83bb-1b8663e2bbe7" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e730ffc-01ca-43db-a1ff-8677172d0089]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:56 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 Sep 30 22:30:56 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:56 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7" returned: 0 in 0.352s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:56 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7 Sep 30 22:30:56 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:56 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5343d458-efad-4d4f-83bb-1b8663e2bbe7" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-5343d458-efad-4d4f-83bb-1b8663e2bbe7" released by "delete_volume" :: held 0.639s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Created reservations ['69da36be-3fc3-4eb4-88fc-093171dccf6b', '19cffe28-a758-4930-a422-4889d5bf318c', 'a6339178-b30b-4535-a60e-7e5aedb3c6ad', '17e90fc5-5a44-4dce-949a-660054e72537'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:56 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:56 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:57 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Deleted volume successfully. Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-676148d6-607f-41e8-801c-46d2b5343afe tempest-VolumesGetTest-1532444045 None] Lock "cinder-5343d458-efad-4d4f-83bb-1b8663e2bbe7-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-8b360c34-e13e-4eec-93b1-05763453ba88-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Lock "cinder-8b360c34-e13e-4eec-93b1-05763453ba88-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Acquiring lock "cinder-quobyte-8b360c34-e13e-4eec-93b1-05763453ba88" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-8b360c34-e13e-4eec-93b1-05763453ba88" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14e027d-3a64-421b-98fd-a583ce934642]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:57 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 Sep 30 22:30:57 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:57 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:57 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88 Sep 30 22:30:57 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:57 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8b360c34-e13e-4eec-93b1-05763453ba88" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Lock "cinder-quobyte-8b360c34-e13e-4eec-93b1-05763453ba88" released by "delete_volume" :: held 0.643s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:30:57 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Created reservations ['f8a48881-3b97-42a1-bc15-5eb3e5061302', '3d9a2820-1595-4bd3-9a9e-6813b9222a9e', '7980f1f3-2b59-4fab-87e5-2790ee18200b', 'f2693492-7c83-49cc-b5d3-a28dbb62c9d7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:30:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:30:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:30:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:30:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:30:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:30:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:30:58 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:30:58 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:30:58 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 30 22:30:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:30:58 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:30:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Deleted volume successfully. Sep 30 22:30:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d93c99c6-390e-4300-bee1-30e87290ee4f tempest-VolumesGetTest-1532444045 None] Lock "cinder-8b360c34-e13e-4eec-93b1-05763453ba88-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:03 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:31:03 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:03 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:31:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Flow 'volume_create_manager' (b44d70f6-0079-48a3-aa7b-d8186d334245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce695ba4-2944-4dbe-854c-8e8a8d0907f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce695ba4-2944-4dbe-854c-8e8a8d0907f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-729730338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d895585c-8b11-4707-af53-16e1da574ed3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c83d8ed08a0b45c483ee6bee8d4bf94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:04Z,use_quota=True,user_id='447bfa2b59f64584b0048d85c47c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365fff8a-b0b7-4275-b5dd-a41dfd3e20ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365fff8a-b0b7-4275-b5dd-a41dfd3e20ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c8f1e1-4f72-47ca-afff-8ebddce31d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c8f1e1-4f72-47ca-afff-8ebddce31d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd895585c-8b11-4707-af53-16e1da574ed3', 'volume_name': 'volume-d895585c-8b11-4707-af53-16e1da574ed3', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d738262-25fa-4119-b4f5-6e36c4dce655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d738262-25fa-4119-b4f5-6e36c4dce655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181cd2d6-45ec-455c-a9b9-ee5574d9f9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Volume d895585c-8b11-4707-af53-16e1da574ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d895585c-8b11-4707-af53-16e1da574ed3', 'volume_size': 1} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-729730338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d895585c-8b11-4707-af53-16e1da574ed3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c83d8ed08a0b45c483ee6bee8d4bf94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:04Z,use_quota=True,user_id='447bfa2b59f64584b0048d85c47c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Creating volume d895585c-8b11-4707-af53-16e1da574ed3 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:31:04 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:04 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3 1073741824 Sep 30 22:31:04 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:04 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3 1073741824" returned: 0 in 0.414s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:05 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3 Sep 30 22:31:05 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:05 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181cd2d6-45ec-455c-a9b9-ee5574d9f9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d895585c-8b11-4707-af53-16e1da574ed3', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7767a6b-c656-4b43-877a-cb5232834775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Volume volume-d895585c-8b11-4707-af53-16e1da574ed3 (d895585c-8b11-4707-af53-16e1da574ed3): created successfully Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7767a6b-c656-4b43-877a-cb5232834775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Flow 'volume_create_manager' (b44d70f6-0079-48a3-aa7b-d8186d334245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8d9d5cdc-7746-431c-bc75-ab00b0373dfe tempest-VolumesListTestJSON-161126362 None] Created volume successfully. Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Flow 'volume_create_manager' (0d9e3e84-05bc-457a-9e1d-230a63de55fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25ff860-2bba-426e-8337-0290f9f025eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25ff860-2bba-426e-8337-0290f9f025eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477584305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece400bb-38cb-4182-9db9-515b1ab2cf79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c83d8ed08a0b45c483ee6bee8d4bf94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:06Z,use_quota=True,user_id='447bfa2b59f64584b0048d85c47c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c7e551-7794-4468-bd12-7ff104e0bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c7e551-7794-4468-bd12-7ff104e0bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b91c3d1-1cbe-4753-bad5-2bff58a52ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b91c3d1-1cbe-4753-bad5-2bff58a52ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece400bb-38cb-4182-9db9-515b1ab2cf79', 'volume_name': 'volume-ece400bb-38cb-4182-9db9-515b1ab2cf79', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86707c51-0b95-4be4-841a-fbbce37dae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86707c51-0b95-4be4-841a-fbbce37dae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c9b44d-bcfc-46a1-bb6f-68f567db8da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Volume ece400bb-38cb-4182-9db9-515b1ab2cf79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece400bb-38cb-4182-9db9-515b1ab2cf79', 'volume_size': 1} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477584305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece400bb-38cb-4182-9db9-515b1ab2cf79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c83d8ed08a0b45c483ee6bee8d4bf94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:06Z,use_quota=True,user_id='447bfa2b59f64584b0048d85c47c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Creating volume ece400bb-38cb-4182-9db9-515b1ab2cf79 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:31:06 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:06 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 1073741824 Sep 30 22:31:06 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:06 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 1073741824" returned: 0 in 0.410s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:06 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 Sep 30 22:31:06 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:06 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c9b44d-bcfc-46a1-bb6f-68f567db8da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece400bb-38cb-4182-9db9-515b1ab2cf79', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2e4af2-0691-462c-ac8d-21666f6bd66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Volume volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 (ece400bb-38cb-4182-9db9-515b1ab2cf79): created successfully Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2e4af2-0691-462c-ac8d-21666f6bd66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Flow 'volume_create_manager' (0d9e3e84-05bc-457a-9e1d-230a63de55fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c8f10cc2-7a35-4a35-a49a-947334f074d0 tempest-VolumesListTestJSON-161126362 None] Created volume successfully. Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Flow 'volume_create_manager' (28764b21-084e-4c0d-ac53-7e94336faa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc69182-ddb8-444c-8be8-a02e61b94f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc69182-ddb8-444c-8be8-a02e61b94f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1380288327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3bb4ab4-b16c-4d9a-8b49-5ca712973a14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c83d8ed08a0b45c483ee6bee8d4bf94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:07Z,use_quota=True,user_id='447bfa2b59f64584b0048d85c47c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3fe04d-e6b7-4d2c-980e-95c99bc9c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3fe04d-e6b7-4d2c-980e-95c99bc9c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab257c5-d9c6-4740-8372-be6791f4fda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab257c5-d9c6-4740-8372-be6791f4fda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3bb4ab4-b16c-4d9a-8b49-5ca712973a14', 'volume_name': 'volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732a9b1d-1b4a-4682-af92-f2238e54f6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732a9b1d-1b4a-4682-af92-f2238e54f6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85a237c-4889-4cab-955b-f1c8653ddda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Volume c3bb4ab4-b16c-4d9a-8b49-5ca712973a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14', 'volume_size': 1} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1380288327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3bb4ab4-b16c-4d9a-8b49-5ca712973a14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c83d8ed08a0b45c483ee6bee8d4bf94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:07Z,use_quota=True,user_id='447bfa2b59f64584b0048d85c47c5b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Creating volume c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:31:07 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:07 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 1073741824 Sep 30 22:31:07 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:07 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 1073741824" returned: 0 in 0.402s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:07 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 Sep 30 22:31:07 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:08 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:31:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85a237c-4889-4cab-955b-f1c8653ddda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6336a8a-7564-440e-9e42-e541f995062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Volume volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 (c3bb4ab4-b16c-4d9a-8b49-5ca712973a14): created successfully Sep 30 22:31:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6336a8a-7564-440e-9e42-e541f995062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Flow 'volume_create_manager' (28764b21-084e-4c0d-ac53-7e94336faa96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9f553226-46e8-41c1-95b8-61810883e87d tempest-VolumesListTestJSON-161126362 None] Created volume successfully. Sep 30 22:31:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Acquiring lock "cinder-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:31:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Lock "cinder-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:31:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Acquiring lock "cinder-quobyte-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:31:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Lock "cinder-quobyte-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:31:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fa7a82-e761-4c0f-8431-da3d6fb9ab8d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:31:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:10 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 Sep 30 22:31:10 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:11 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14" returned: 0 in 0.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:11 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14 Sep 30 22:31:11 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:11 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Lock "cinder-quobyte-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14" released by "delete_volume" :: held 0.636s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Created reservations ['9c034672-a8f5-4145-9916-49349e4f25c8', 'a9a33d73-d6d9-4e76-84a2-081bff7542e8', 'b784e75a-86a3-423d-954f-d64cdfc461bd', 'fafcf866-1395-4858-8d35-8363088ca534'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:11 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:31:11 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:11 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.238s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:31:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Deleted volume successfully. Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c3a3ee5-4d03-4198-9785-c69403e1029a tempest-VolumesListTestJSON-161126362 None] Lock "cinder-c3bb4ab4-b16c-4d9a-8b49-5ca712973a14-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Acquiring lock "cinder-ece400bb-38cb-4182-9db9-515b1ab2cf79-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Lock "cinder-ece400bb-38cb-4182-9db9-515b1ab2cf79-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Acquiring lock "cinder-quobyte-ece400bb-38cb-4182-9db9-515b1ab2cf79" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Lock "cinder-quobyte-ece400bb-38cb-4182-9db9-515b1ab2cf79" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beb40d7-eb6b-4976-99aa-b557fd6d5923]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:31:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:11 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 Sep 30 22:31:11 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:12 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79" returned: 0 in 0.351s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:12 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79 Sep 30 22:31:12 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:12 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ece400bb-38cb-4182-9db9-515b1ab2cf79" returned: 0 in 0.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Lock "cinder-quobyte-ece400bb-38cb-4182-9db9-515b1ab2cf79" released by "delete_volume" :: held 0.633s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Created reservations ['f80bfa31-ae8f-4d17-b707-8bbb64e48e45', 'dd6eb52e-2441-4571-b3f6-b3be9849a9d1', 'e96dfed4-6d3e-4296-b1a2-a1be55d1b30a', 'cd8f8b0e-4d01-41ea-8e67-85760a802bbf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:12 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:31:12 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:12 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.235s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:31:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Deleted volume successfully. Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d2cf827-1dfa-4e4e-a5ba-bd4382cd5f5a tempest-VolumesListTestJSON-161126362 None] Lock "cinder-ece400bb-38cb-4182-9db9-515b1ab2cf79-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Acquiring lock "cinder-d895585c-8b11-4707-af53-16e1da574ed3-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:31:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Lock "cinder-d895585c-8b11-4707-af53-16e1da574ed3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Acquiring lock "cinder-quobyte-d895585c-8b11-4707-af53-16e1da574ed3" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Lock "cinder-quobyte-d895585c-8b11-4707-af53-16e1da574ed3" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfbd9b1-c7f5-41ae-9762-dd5032b2c44b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:13 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3 Sep 30 22:31:13 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:13 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3" returned: 0 in 0.352s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:13 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3 Sep 30 22:31:13 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:13 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d895585c-8b11-4707-af53-16e1da574ed3" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Lock "cinder-quobyte-d895585c-8b11-4707-af53-16e1da574ed3" released by "delete_volume" :: held 0.631s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Created reservations ['5a526dc9-066d-4406-bf74-bad72bba2d54', 'af42c83d-c351-4849-b545-c282b3ba0a16', '878f0a4e-8a58-4ad5-95af-a947e156d10e', '23976be4-9783-4053-af0c-82a9d1d30c13'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:13 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:31:13 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:14 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:14 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:31:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Deleted volume successfully. Sep 30 22:31:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12cf8544-b561-44d9-a93b-08a7a3d56629 tempest-VolumesListTestJSON-161126362 None] Lock "cinder-d895585c-8b11-4707-af53-16e1da574ed3-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:31:23 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=61,cinder:INSERT=26,cinder:UPDATE=89,cinder:DELETE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:31:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=85,cinder:SELECT=61,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Flow 'volume_create_manager' (7a4c3ce1-dda2-48d5-933d-591827ac5d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150f6a59-a78e-444f-9916-de942f7dca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150f6a59-a78e-444f-9916-de942f7dca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1780094805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafa60ec-0571-45cc-8740-1c15e86c6a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6daf30a3b546509c87b64bf0294bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:38Z,use_quota=True,user_id='d3c3b146e2764a32971a9a294b0cac52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5855597-d8e6-4002-87c0-d10fe5826f15),volume_type_id=d5855597-d8e6-4002-87c0-d10fe5826f15)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61618a36-45c5-4721-925c-9d7008f37dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61618a36-45c5-4721-925c-9d7008f37dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5f2fed-abf2-42ff-a178-200c58c28496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5f2fed-abf2-42ff-a178-200c58c28496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dafa60ec-0571-45cc-8740-1c15e86c6a43', 'volume_name': 'volume-dafa60ec-0571-45cc-8740-1c15e86c6a43', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff081a03-d3f0-4b6e-a81c-be6a1f6e8ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff081a03-d3f0-4b6e-a81c-be6a1f6e8ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa841805-3fc9-4168-9659-256bb61aa03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Volume dafa60ec-0571-45cc-8740-1c15e86c6a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dafa60ec-0571-45cc-8740-1c15e86c6a43', 'volume_size': 1} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1780094805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dafa60ec-0571-45cc-8740-1c15e86c6a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6daf30a3b546509c87b64bf0294bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:38Z,use_quota=True,user_id='d3c3b146e2764a32971a9a294b0cac52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5855597-d8e6-4002-87c0-d10fe5826f15),volume_type_id=d5855597-d8e6-4002-87c0-d10fe5826f15)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Creating volume dafa60ec-0571-45cc-8740-1c15e86c6a43 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:31:38 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:38 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 1073741824 Sep 30 22:31:38 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Flow 'volume_create_manager' (d40f4377-49e8-4f0c-a373-17ba836d6524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e38c00-a003-403d-ad86-3727004604c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e38c00-a003-403d-ad86-3727004604c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1911198437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1bc085-035e-44de-b2f9-1da8ac63fb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6daf30a3b546509c87b64bf0294bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:39Z,use_quota=True,user_id='d3c3b146e2764a32971a9a294b0cac52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6809b8df-65d1-4787-b108-2c8b603dfadb),volume_type_id=6809b8df-65d1-4787-b108-2c8b603dfadb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb10ab3-a386-402f-a06b-30233b7eba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb10ab3-a386-402f-a06b-30233b7eba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad868eac-93ee-4459-8e90-d4345bb37cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad868eac-93ee-4459-8e90-d4345bb37cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca1bc085-035e-44de-b2f9-1da8ac63fb52', 'volume_name': 'volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af54930-cdf5-475f-b13d-000766f9f65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af54930-cdf5-475f-b13d-000766f9f65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8a6392-5648-489e-9167-5ef8e8399e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Volume ca1bc085-035e-44de-b2f9-1da8ac63fb52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52', 'volume_size': 1} Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:38 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 1073741824" returned: 0 in 0.497s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:39 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 Sep 30 22:31:39 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:39 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43" returned: 0 in 0.260s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.389s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1911198437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1bc085-035e-44de-b2f9-1da8ac63fb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6daf30a3b546509c87b64bf0294bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:39Z,use_quota=True,user_id='d3c3b146e2764a32971a9a294b0cac52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6809b8df-65d1-4787-b108-2c8b603dfadb),volume_type_id=6809b8df-65d1-4787-b108-2c8b603dfadb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Creating volume ca1bc085-035e-44de-b2f9-1da8ac63fb52 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:31:39 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa841805-3fc9-4168-9659-256bb61aa03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dafa60ec-0571-45cc-8740-1c15e86c6a43', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:39 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 1073741824 Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf800e6e-7360-41f6-8f51-3132b0608cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:39 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Volume volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 (dafa60ec-0571-45cc-8740-1c15e86c6a43): created successfully Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf800e6e-7360-41f6-8f51-3132b0608cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Flow 'volume_create_manager' (7a4c3ce1-dda2-48d5-933d-591827ac5d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Flow 'volume_create_manager' (a59d0c9a-a6d5-4f22-995b-da56299b8f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3f446c-c139-45cb-8157-ad42ddce558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6b691581-4621-4620-ad81-5785dd19d2ad tempest-TestInstancesWithCinderVolumes-529463943 None] Created volume successfully. Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3f446c-c139-45cb-8157-ad42ddce558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-664001476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90297f2e-ee28-49b8-baf5-7f14817c0968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6daf30a3b546509c87b64bf0294bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:39Z,use_quota=True,user_id='d3c3b146e2764a32971a9a294b0cac52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5dfe2ef-256f-4b71-83fb-7a5c7f01acf5),volume_type_id=b5dfe2ef-256f-4b71-83fb-7a5c7f01acf5)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890fb680-c0c4-4aaf-aa2f-19dc1419d843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890fb680-c0c4-4aaf-aa2f-19dc1419d843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6361c6a3-5c98-4588-b4db-277fca386a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6361c6a3-5c98-4588-b4db-277fca386a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90297f2e-ee28-49b8-baf5-7f14817c0968', 'volume_name': 'volume-90297f2e-ee28-49b8-baf5-7f14817c0968', 'volume_size': 1, 'image_id': '8178faba-4fe2-4313-a55b-10e2624cb558', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8178faba-4fe2-4313-a55b-10e2624cb558', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2030300257', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e6daf30a3b546509c87b64bf0294bbb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8178faba-4fe2-4313-a55b-10e2624cb558', 'created_at': datetime.datetime(2026, 9, 30, 20, 31, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 31, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8178faba-4fe2-4313-a55b-10e2624cb558/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b66fb1-224f-4835-ae1e-d53ee87f661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b66fb1-224f-4835-ae1e-d53ee87f661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df63f58-96bd-4edb-8d73-201546ffa083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Volume 90297f2e-ee28-49b8-baf5-7f14817c0968: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90297f2e-ee28-49b8-baf5-7f14817c0968', 'volume_size': 1, 'image_id': '8178faba-4fe2-4313-a55b-10e2624cb558', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8178faba-4fe2-4313-a55b-10e2624cb558', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2030300257', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e6daf30a3b546509c87b64bf0294bbb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8178faba-4fe2-4313-a55b-10e2624cb558', 'created_at': datetime.datetime(2026, 9, 30, 20, 31, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 31, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8178faba-4fe2-4313-a55b-10e2624cb558/file', 'properties': {}}, 'image_service': } Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Trying to clone 90297f2e-ee28-49b8-baf5-7f14817c0968 from image 8178faba-4fe2-4313-a55b-10e2624cb558 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8178faba-4fe2-4313-a55b-10e2624cb558', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:31:39 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 1073741824" returned: 0 in 0.453s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:39 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 Sep 30 22:31:39 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:40 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:31:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8a6392-5648-489e-9167-5ef8e8399e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e01273-4e59-4064-a611-b78462d4ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Volume volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 (ca1bc085-035e-44de-b2f9-1da8ac63fb52): created successfully Sep 30 22:31:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28e01273-4e59-4064-a611-b78462d4ca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Flow 'volume_create_manager' (d40f4377-49e8-4f0c-a373-17ba836d6524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-295ab345-ae46-4297-bffb-218c34bb941e tempest-TestInstancesWithCinderVolumes-529463943 None] Created volume successfully. Sep 30 22:31:42 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD, size 20.69 MB, duration 2.88 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:31:42 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Image download 20.69 MB at 7.19 MB/s Sep 30 22:31:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[09113eda-aa71-4545-8d89-38a4a1936b96]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:31:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:42 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD Sep 30 22:31:42 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:42 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:42 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Temporary image 8178faba-4fe2-4313-a55b-10e2624cb558 is fetched for user d3c3b146e2764a32971a9a294b0cac52. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab97e9b-ae98-4a97-a161-78d7de59953d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:43 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD Sep 30 22:31:43 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:43 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-664001476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90297f2e-ee28-49b8-baf5-7f14817c0968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6daf30a3b546509c87b64bf0294bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:31:39Z,use_quota=True,user_id='d3c3b146e2764a32971a9a294b0cac52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5dfe2ef-256f-4b71-83fb-7a5c7f01acf5),volume_type_id=b5dfe2ef-256f-4b71-83fb-7a5c7f01acf5)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Creating volume 90297f2e-ee28-49b8-baf5-7f14817c0968 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:31:43 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:43 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 1073741824 Sep 30 22:31:43 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:43 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 1073741824" returned: 0 in 0.405s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:43 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 Sep 30 22:31:43 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:44 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Attempting download of 8178faba-4fe2-4313-a55b-10e2624cb558 ((None, [{'url': 'file:///opt/stack/data/glance/images/8178faba-4fe2-4313-a55b-10e2624cb558', 'metadata': {}}])) to volume 90297f2e-ee28-49b8-baf5-7f14817c0968. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b05f2c-d1a4-42a1-bbc6-90883952f017]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8178faba-4fe2-4313-a55b-10e2624cb558_rvfue46w {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:44 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8178faba-4fe2-4313-a55b-10e2624cb558_rvfue46w Sep 30 22:31:44 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:44 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8178faba-4fe2-4313-a55b-10e2624cb558_rvfue46w" returned: 0 in 0.321s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8178faba-4fe2-4313-a55b-10e2624cb558_rvfue46w {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:44 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8178faba-4fe2-4313-a55b-10e2624cb558_rvfue46w Sep 30 22:31:44 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:44 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8178faba-4fe2-4313-a55b-10e2624cb558_rvfue46w" returned: 1 in 0.315s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8178faba-4fe2-4313-a55b-10e2624cb558_rvfue46w' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[398f9e50-bd1b-48a5-8b64-c88067cd42bc]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:44 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD Sep 30 22:31:44 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:45 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:45 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] 8178faba-4fe2-4313-a55b-10e2624cb558 was qcow2, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:31:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:45 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 Sep 30 22:31:45 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:46 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968" returned: 0 in 1.670s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:46 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8178faba-4fe2-4313-a55b-10e2624cb558_1d616zxtdevstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:31:46 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Converted 112.00 MB image at 67.01 MB/s Sep 30 22:31:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:31:46 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 1G Sep 30 22:31:46 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:31:47 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 1G" returned: 0 in 0.303s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Downloaded image 8178faba-4fe2-4313-a55b-10e2624cb558 ((None, [{'url': 'file:///opt/stack/data/glance/images/8178faba-4fe2-4313-a55b-10e2624cb558', 'metadata': {}}])) to volume 90297f2e-ee28-49b8-baf5-7f14817c0968 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Temporary image 8178faba-4fe2-4313-a55b-10e2624cb558 for user d3c3b146e2764a32971a9a294b0cac52 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Marking volume 90297f2e-ee28-49b8-baf5-7f14817c0968 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Copying metadata from image 8178faba-4fe2-4313-a55b-10e2624cb558 to 90297f2e-ee28-49b8-baf5-7f14817c0968. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Creating volume glance metadata for volume 90297f2e-ee28-49b8-baf5-7f14817c0968 backed by image 8178faba-4fe2-4313-a55b-10e2624cb558 with: {'image_id': '8178faba-4fe2-4313-a55b-10e2624cb558', 'image_name': 'tempest-scenario-img--2030300257', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df63f58-96bd-4edb-8d73-201546ffa083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90297f2e-ee28-49b8-baf5-7f14817c0968', 'volume_size': 1, 'image_id': '8178faba-4fe2-4313-a55b-10e2624cb558', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8178faba-4fe2-4313-a55b-10e2624cb558', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2030300257', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e6daf30a3b546509c87b64bf0294bbb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8178faba-4fe2-4313-a55b-10e2624cb558', 'created_at': datetime.datetime(2026, 9, 30, 20, 31, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 31, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8178faba-4fe2-4313-a55b-10e2624cb558/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61704c70-aa63-45f4-bfc0-bb2b30bc322f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:31:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Volume volume-90297f2e-ee28-49b8-baf5-7f14817c0968 (90297f2e-ee28-49b8-baf5-7f14817c0968): created successfully Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61704c70-aa63-45f4-bfc0-bb2b30bc322f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Flow 'volume_create_manager' (a59d0c9a-a6d5-4f22-995b-da56299b8f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:31:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d0ec15ac-d29a-4491-a425-38b0d41f747c tempest-TestInstancesWithCinderVolumes-529463943 None] Created volume successfully. Sep 30 22:31:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-396eb019-756d-4e7e-84e1-cd07e7ff3a16 req-352aa297-2fc3-4c42-9c26-75c0f7c7017c tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:31:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-396eb019-756d-4e7e-84e1-cd07e7ff3a16 req-352aa297-2fc3-4c42-9c26-75c0f7c7017c tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:31:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-396eb019-756d-4e7e-84e1-cd07e7ff3a16 req-352aa297-2fc3-4c42-9c26-75c0f7c7017c tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:31:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-396eb019-756d-4e7e-84e1-cd07e7ff3a16 req-352aa297-2fc3-4c42-9c26-75c0f7c7017c tempest-TestInstancesWithCinderVolumes-529463943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-90297f2e-ee28-49b8-baf5-7f14817c0968', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9226a314-21bf-4a7c-bec8-af1b865536ae', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:31:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-396eb019-756d-4e7e-84e1-cd07e7ff3a16 req-352aa297-2fc3-4c42-9c26-75c0f7c7017c tempest-TestInstancesWithCinderVolumes-529463943 None] attachment_update completed successfully. Sep 30 22:32:00 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:32:00 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=12,cinder:SELECT=20,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:03 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:32:03 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:03 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:32:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:32:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-3eb1a0ba-709d-44de-94f6-c478194244c5 req-d7b528d8-150e-47aa-ad66-6e07cd074120 tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:32:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-3eb1a0ba-709d-44de-94f6-c478194244c5 req-d7b528d8-150e-47aa-ad66-6e07cd074120 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:32:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-3eb1a0ba-709d-44de-94f6-c478194244c5 req-d7b528d8-150e-47aa-ad66-6e07cd074120 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:32:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-3eb1a0ba-709d-44de-94f6-c478194244c5 req-d7b528d8-150e-47aa-ad66-6e07cd074120 tempest-TestInstancesWithCinderVolumes-529463943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-dafa60ec-0571-45cc-8740-1c15e86c6a43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d8f2ead-ca35-4dc4-aeca-dfe7ea97c530', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:32:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-3eb1a0ba-709d-44de-94f6-c478194244c5 req-d7b528d8-150e-47aa-ad66-6e07cd074120 tempest-TestInstancesWithCinderVolumes-529463943 None] attachment_update completed successfully. Sep 30 22:32:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-70036739-86ae-4736-bdcc-272c98c5182f req-a353be6c-b232-4dac-9311-a1a046dbae27 tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:32:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-70036739-86ae-4736-bdcc-272c98c5182f req-a353be6c-b232-4dac-9311-a1a046dbae27 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:32:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-70036739-86ae-4736-bdcc-272c98c5182f req-a353be6c-b232-4dac-9311-a1a046dbae27 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:32:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-70036739-86ae-4736-bdcc-272c98c5182f req-a353be6c-b232-4dac-9311-a1a046dbae27 tempest-TestInstancesWithCinderVolumes-529463943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816', 'name': 'volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62b04510-e495-4790-8f38-4462aedd4ebf', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 30 22:32:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-70036739-86ae-4736-bdcc-272c98c5182f req-a353be6c-b232-4dac-9311-a1a046dbae27 tempest-TestInstancesWithCinderVolumes-529463943 None] attachment_update completed successfully. Sep 30 22:32:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-d3d96f0d-c276-432c-9eff-e9d70b2b9289 req-e8fa188b-b383-40a1-996b-d32b6062599e tempest-TestInstancesWithCinderVolumes-529463943 None] Terminate volume connection completed successfully. Sep 30 22:32:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-d3d96f0d-c276-432c-9eff-e9d70b2b9289 req-e8fa188b-b383-40a1-996b-d32b6062599e tempest-TestInstancesWithCinderVolumes-529463943 None] Deleting attachment 8d8f2ead-ca35-4dc4-aeca-dfe7ea97c530. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:32:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "cinder-dafa60ec-0571-45cc-8740-1c15e86c6a43-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:32:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-dafa60ec-0571-45cc-8740-1c15e86c6a43-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:32:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "cinder-quobyte-dafa60ec-0571-45cc-8740-1c15e86c6a43" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:32:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-quobyte-dafa60ec-0571-45cc-8740-1c15e86c6a43" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:32:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[059ef793-9803-4afd-90d1-219042f91eac]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:32:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:30 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 Sep 30 22:32:30 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:31 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43" returned: 0 in 0.385s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:31 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43 Sep 30 22:32:31 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:31 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dafa60ec-0571-45cc-8740-1c15e86c6a43" returned: 0 in 0.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-quobyte-dafa60ec-0571-45cc-8740-1c15e86c6a43" released by "delete_volume" :: held 0.691s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:32:31 devstack cinder-volume[87240]: WARNING cinder.quota [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1597541014-883637033 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1597541014-883637033, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:32:31 devstack cinder-volume[87240]: WARNING cinder.quota [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1597541014-883637033 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1597541014-883637033, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Created reservations ['83ee8abf-7a2c-41fa-95c5-6412d6c36f91', '247cfc40-0384-4418-9dee-7038d56ae021', 'c0ae43e4-a22f-41ac-a991-35c41aa94f0a', '6ef64cb0-6ef6-43ae-b525-be7555fc04e4'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:31 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:32:31 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:31 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.261s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:32:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Deleted volume successfully. Sep 30 22:32:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-60b06afb-a61d-4062-ac03-117e08b02f7e tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-dafa60ec-0571-45cc-8740-1c15e86c6a43-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:32:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-aee74385-3e9f-40b4-882e-393d8ea7a867 req-b17173b5-953c-45b3-8f29-d4d718d8660f tempest-TestInstancesWithCinderVolumes-529463943 None] Terminate volume connection completed successfully. Sep 30 22:32:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-aee74385-3e9f-40b4-882e-393d8ea7a867 req-b17173b5-953c-45b3-8f29-d4d718d8660f tempest-TestInstancesWithCinderVolumes-529463943 None] Deleting attachment 62b04510-e495-4790-8f38-4462aedd4ebf. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:32:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "cinder-ca1bc085-035e-44de-b2f9-1da8ac63fb52-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:32:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-ca1bc085-035e-44de-b2f9-1da8ac63fb52-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:32:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "cinder-quobyte-ca1bc085-035e-44de-b2f9-1da8ac63fb52" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:32:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-quobyte-ca1bc085-035e-44de-b2f9-1da8ac63fb52" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:32:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b085861-87d7-44a0-b221-e8b16a4c9f3f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:32:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:34 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 Sep 30 22:32:34 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:35 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52" returned: 0 in 0.378s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:35 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52 Sep 30 22:32:35 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:35 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ca1bc085-035e-44de-b2f9-1da8ac63fb52" returned: 0 in 0.253s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-quobyte-ca1bc085-035e-44de-b2f9-1da8ac63fb52" released by "delete_volume" :: held 0.684s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:32:35 devstack cinder-volume[87240]: WARNING cinder.quota [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-5219323-1803643083 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-5219323-1803643083, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:32:35 devstack cinder-volume[87240]: WARNING cinder.quota [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-5219323-1803643083 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-5219323-1803643083, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Created reservations ['9fc08843-6b8b-4cf0-b974-90d25cff3cd4', 'fa4f7c08-4719-429a-9466-01c2f5cdae72', 'fcd71d43-e308-419a-905d-f67a0d11e1e9', 'f0ba01bc-439c-4356-9659-a6b91be70be9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:35 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:32:35 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:35 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.290s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:32:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Deleted volume successfully. Sep 30 22:32:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f52131f4-317a-438d-88fe-3de6b0add54b tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-ca1bc085-035e-44de-b2f9-1da8ac63fb52-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:32:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-3bfd09eb-2fa7-4534-9f44-ef78609606c4 req-c4762f42-b850-447d-a8e5-3850dcec839b tempest-TestInstancesWithCinderVolumes-529463943 None] Terminate volume connection completed successfully. Sep 30 22:32:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-3bfd09eb-2fa7-4534-9f44-ef78609606c4 req-c4762f42-b850-447d-a8e5-3850dcec839b tempest-TestInstancesWithCinderVolumes-529463943 None] Deleting attachment 9226a314-21bf-4a7c-bec8-af1b865536ae. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 30 22:32:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "cinder-90297f2e-ee28-49b8-baf5-7f14817c0968-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:32:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-90297f2e-ee28-49b8-baf5-7f14817c0968-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:32:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "cinder-quobyte-90297f2e-ee28-49b8-baf5-7f14817c0968" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:32:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-quobyte-90297f2e-ee28-49b8-baf5-7f14817c0968" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:32:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea1a1b5-5310-4b2f-9997-994263c36a4d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:32:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:39 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 Sep 30 22:32:39 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:39 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:39 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968 Sep 30 22:32:39 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:40 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-90297f2e-ee28-49b8-baf5-7f14817c0968" returned: 0 in 0.238s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-quobyte-90297f2e-ee28-49b8-baf5-7f14817c0968" released by "delete_volume" :: held 0.636s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:32:40 devstack cinder-volume[87240]: WARNING cinder.quota [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437906856-2115069608 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437906856-2115069608, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:32:40 devstack cinder-volume[87240]: WARNING cinder.quota [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437906856-2115069608 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437906856-2115069608, it is now deprecated. Please use the default quota class for default quota. Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Created reservations ['8abc8876-17df-47b2-8cd1-a1d8941d418b', '74a124c6-fc0e-4200-b8c2-b99f0f36e3ee', '38789c0a-4724-4f29-8d51-4054bfb65a54', '8f4b1bca-678c-48e5-901b-974404928161'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:32:40 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:32:40 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:32:40 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:32:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Deleted volume successfully. Sep 30 22:32:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9993ac67-5dc6-4c6d-96eb-2e34c64a0e90 tempest-TestInstancesWithCinderVolumes-529463943 None] Lock "cinder-90297f2e-ee28-49b8-baf5-7f14817c0968-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:32:50 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=30,cinder:UPDATE=25,cinder:INSERT=8 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:32:50 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=30,cinder:SELECT=33,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:03 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:33:03 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:03 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.246s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:33:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Flow 'volume_create_manager' (46f5e7b9-4b54-4ee7-ae50-91495cc8ab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11696f91-59f4-4bc7-8226-abff68ba2ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11696f91-59f4-4bc7-8226-abff68ba2ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1930191528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8feb9af-103d-4e19-83ca-ad929caa97d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ba9df274424740ba4087367a4d7aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:09Z,use_quota=True,user_id='7e9ba18390044e8998eb2dfd42b23980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a65e058-7f61-474e-8352-982ffa892b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a65e058-7f61-474e-8352-982ffa892b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad5e2a1-6d8a-417e-9313-1b7e21a8ce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad5e2a1-6d8a-417e-9313-1b7e21a8ce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8feb9af-103d-4e19-83ca-ad929caa97d5', 'volume_name': 'volume-f8feb9af-103d-4e19-83ca-ad929caa97d5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f558c3df-8073-483b-9d4e-7bcba20eae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f558c3df-8073-483b-9d4e-7bcba20eae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b8f408-36b8-44e6-842e-7cfecba55a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Volume f8feb9af-103d-4e19-83ca-ad929caa97d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8feb9af-103d-4e19-83ca-ad929caa97d5', 'volume_size': 1} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1930191528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8feb9af-103d-4e19-83ca-ad929caa97d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ba9df274424740ba4087367a4d7aa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:09Z,use_quota=True,user_id='7e9ba18390044e8998eb2dfd42b23980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Creating volume f8feb9af-103d-4e19-83ca-ad929caa97d5 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:33:08 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:33:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:08 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 1073741824 Sep 30 22:33:08 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:09 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 1073741824" returned: 0 in 0.406s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:09 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 Sep 30 22:33:09 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:09 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:33:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b8f408-36b8-44e6-842e-7cfecba55a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8feb9af-103d-4e19-83ca-ad929caa97d5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6887fdc-cb01-4175-9a59-f69dc49ff230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Volume volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 (f8feb9af-103d-4e19-83ca-ad929caa97d5): created successfully Sep 30 22:33:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6887fdc-cb01-4175-9a59-f69dc49ff230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Flow 'volume_create_manager' (46f5e7b9-4b54-4ee7-ae50-91495cc8ab82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1077084c-c3cc-49ce-b432-814745c5dc0c tempest-TestImageHashVerification-2144476380 None] Created volume successfully. Sep 30 22:33:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a086ee6-3473-45a0-8b6f-e7a527b66eba]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:33:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:10 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 Sep 30 22:33:10 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:10 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5" returned: 0 in 0.357s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0df825-376a-4fca-8e47-5cce6a6e073c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:33:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:10 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 Sep 30 22:33:10 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:11 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 /opt/stack/data/cinder/conversion/f8feb9af-103d-4e19-83ca-ad929caa97d5.temp_image.c6bf92b7-9bd7-4a95-9143-00b71b866a35c96p6ay8.img {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:11 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 /opt/stack/data/cinder/conversion/f8feb9af-103d-4e19-83ca-ad929caa97d5.temp_image.c6bf92b7-9bd7-4a95-9143-00b71b866a35c96p6ay8.img Sep 30 22:33:11 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:16 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 /opt/stack/data/cinder/conversion/f8feb9af-103d-4e19-83ca-ad929caa97d5.temp_image.c6bf92b7-9bd7-4a95-9143-00b71b866a35c96p6ay8.img" returned: 0 in 5.765s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac42c2a2-f124-40ff-8657-3463e7d2ce7c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:33:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:17 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 Sep 30 22:33:17 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:17 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5" returned: 0 in 0.524s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:17 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/conversion/f8feb9af-103d-4e19-83ca-ad929caa97d5.temp_image.c6bf92b7-9bd7-4a95-9143-00b71b866a35c96p6ay8.img {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:33:17 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Converted 1024.00 MB image at 177.59 MB/s Sep 30 22:33:17 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] c6bf92b7-9bd7-4a95-9143-00b71b866a35 was raw, no need to convert to raw {{(pid=87240) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 30 22:33:27 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3,cinder:INSERT=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:33:27 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:33:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.667s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Uploaded volume to glance image-id: c6bf92b7-9bd7-4a95-9143-00b71b866a35. {{(pid=87240) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 30 22:33:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-76c16eb6-77b0-47c5-96cf-b78ec9dbe853 tempest-TestImageHashVerification-2144476380 None] Copy volume to image completed successfully. Sep 30 22:33:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Acquiring lock "cinder-f8feb9af-103d-4e19-83ca-ad929caa97d5-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Lock "cinder-f8feb9af-103d-4e19-83ca-ad929caa97d5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Acquiring lock "cinder-quobyte-f8feb9af-103d-4e19-83ca-ad929caa97d5" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Lock "cinder-quobyte-f8feb9af-103d-4e19-83ca-ad929caa97d5" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9ca1e8-ec34-4aa9-97c9-f08f0d55e433]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:33:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:37 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 Sep 30 22:33:37 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:37 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5" returned: 0 in 0.362s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:37 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5 Sep 30 22:33:37 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:37 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f8feb9af-103d-4e19-83ca-ad929caa97d5" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Lock "cinder-quobyte-f8feb9af-103d-4e19-83ca-ad929caa97d5" released by "delete_volume" :: held 0.644s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Created reservations ['79c4d804-14d1-4eac-8063-c2bfbd99823d', '8df47106-8efd-4ec4-b6e9-36597e75331e', '8d29eaec-34e0-401a-94c2-bc7c07fa713a', '0b625902-d5f8-4d1e-9c3d-79d36e214911'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:37 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:33:37 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:37 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:33:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Deleted volume successfully. Sep 30 22:33:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e10da7df-3593-4c1f-a3fd-3db0c67b36fe tempest-TestImageHashVerification-2144476380 None] Lock "cinder-f8feb9af-103d-4e19-83ca-ad929caa97d5-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:47 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:33:47 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (1a64c581-59c6-408d-a14b-620c51196120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79aafe16-48df-4882-9643-b8b1afa3a657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79aafe16-48df-4882-9643-b8b1afa3a657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286100797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c13d4a-10ba-4b0d-beea-c57acc72c954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:48Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f12cd7c-b7c6-4d47-b018-725f9ba68234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f12cd7c-b7c6-4d47-b018-725f9ba68234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d36ba5-4060-4018-80cc-1906f4d5eb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d36ba5-4060-4018-80cc-1906f4d5eb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c13d4a-10ba-4b0d-beea-c57acc72c954', 'volume_name': 'volume-04c13d4a-10ba-4b0d-beea-c57acc72c954', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c479eb0-2fb7-410c-96fa-1668449ce5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c479eb0-2fb7-410c-96fa-1668449ce5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebde0b0e-f650-44e5-8749-968433710d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume 04c13d4a-10ba-4b0d-beea-c57acc72c954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c13d4a-10ba-4b0d-beea-c57acc72c954', 'volume_size': 1} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286100797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c13d4a-10ba-4b0d-beea-c57acc72c954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:48Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Creating volume 04c13d4a-10ba-4b0d-beea-c57acc72c954 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:33:48 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:48 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 1073741824 Sep 30 22:33:48 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:48 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 1073741824" returned: 0 in 0.410s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:48 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 Sep 30 22:33:48 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:49 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebde0b0e-f650-44e5-8749-968433710d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c13d4a-10ba-4b0d-beea-c57acc72c954', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb92e488-4900-4a69-97ca-7a796a86451f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 (04c13d4a-10ba-4b0d-beea-c57acc72c954): created successfully Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb92e488-4900-4a69-97ca-7a796a86451f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (1a64c581-59c6-408d-a14b-620c51196120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f4a3855e-2061-452a-b16c-6fca2c082b39 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created volume successfully. Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (f8ea4d4f-a263-4014-bfe5-7aa4247e6b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54902e1-223b-4e0b-90c9-8c8e17303dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54902e1-223b-4e0b-90c9-8c8e17303dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655710880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a1179b-b33a-474a-b280-e77ff7029500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:50Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a762b3-f35a-4002-a243-bc5a82be9cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a762b3-f35a-4002-a243-bc5a82be9cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40aacaa8-287d-43d1-ab6b-5ef87feb21a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40aacaa8-287d-43d1-ab6b-5ef87feb21a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a1179b-b33a-474a-b280-e77ff7029500', 'volume_name': 'volume-82a1179b-b33a-474a-b280-e77ff7029500', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5849deb-3abd-41f4-9706-607032abab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5849deb-3abd-41f4-9706-607032abab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5c000e-94db-4a25-8c3c-4413024e4ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume 82a1179b-b33a-474a-b280-e77ff7029500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a1179b-b33a-474a-b280-e77ff7029500', 'volume_size': 1} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1655710880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a1179b-b33a-474a-b280-e77ff7029500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:50Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Creating volume 82a1179b-b33a-474a-b280-e77ff7029500 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:33:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:49 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500 1073741824 Sep 30 22:33:49 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (89d5182f-95ca-46aa-a271-92e38f158c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d9acb2-67de-4a14-9e73-696a485808f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d9acb2-67de-4a14-9e73-696a485808f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480744006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc7c016-e9ab-4632-a40c-6901482fe890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:50Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba237f07-68ee-4f44-bf95-b2df5f7a5897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba237f07-68ee-4f44-bf95-b2df5f7a5897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911b6893-19d6-4224-a1ce-6b5d9c5a8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911b6893-19d6-4224-a1ce-6b5d9c5a8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc7c016-e9ab-4632-a40c-6901482fe890', 'volume_name': 'volume-5dc7c016-e9ab-4632-a40c-6901482fe890', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e2b99d-30ba-4c90-8d9b-cf476e215673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e2b99d-30ba-4c90-8d9b-cf476e215673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0c0080-ef40-4842-820b-a6409c34d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume 5dc7c016-e9ab-4632-a40c-6901482fe890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc7c016-e9ab-4632-a40c-6901482fe890', 'volume_size': 1} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:50 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500 1073741824" returned: 0 in 0.510s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:50 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500 Sep 30 22:33:50 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (888bc663-ea54-48eb-bff0-e46f758e9037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0aa618-0dda-44fd-a657-4a822a6a277e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0aa618-0dda-44fd-a657-4a822a6a277e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337016007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66eebf4e-d690-4cce-bdbb-b28e0b86e9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:51Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be516075-9345-4119-b03e-54b1be87858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be516075-9345-4119-b03e-54b1be87858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead86331-cfce-49df-98f5-793972cb1854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead86331-cfce-49df-98f5-793972cb1854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66eebf4e-d690-4cce-bdbb-b28e0b86e9be', 'volume_name': 'volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9152344e-46c9-417b-9531-05a8c16a766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9152344e-46c9-417b-9531-05a8c16a766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ed8af7-533f-4759-a42f-bda7bf65b3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume 66eebf4e-d690-4cce-bdbb-b28e0b86e9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be', 'volume_size': 1} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:50 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500" returned: 0 in 0.267s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480744006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc7c016-e9ab-4632-a40c-6901482fe890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:50Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Creating volume 5dc7c016-e9ab-4632-a40c-6901482fe890 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:33:50 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5c000e-94db-4a25-8c3c-4413024e4ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a1179b-b33a-474a-b280-e77ff7029500', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890 1073741824 Sep 30 22:33:50 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351b8c82-3e55-4fff-a487-483bd91d76b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume volume-82a1179b-b33a-474a-b280-e77ff7029500 (82a1179b-b33a-474a-b280-e77ff7029500): created successfully Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351b8c82-3e55-4fff-a487-483bd91d76b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (f8ea4d4f-a263-4014-bfe5-7aa4247e6b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4a930209-a383-43d4-a03d-022d2ff390e2 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created volume successfully. Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (41e2eaef-21ae-4f85-b804-bdf26469d37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1884be29-8270-48ec-9a39-4bc5269f2966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1884be29-8270-48ec-9a39-4bc5269f2966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713674023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99e0aaa-76fc-4cfa-9876-ad652381afa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:51Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54e3d19-6392-4185-abff-c087c45249f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54e3d19-6392-4185-abff-c087c45249f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aed0cca-c11c-4aa2-bda0-5b7e7c7ea82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aed0cca-c11c-4aa2-bda0-5b7e7c7ea82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99e0aaa-76fc-4cfa-9876-ad652381afa3', 'volume_name': 'volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef21d516-60fa-4fd8-bd48-283c66fc71d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef21d516-60fa-4fd8-bd48-283c66fc71d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1115016-721d-4525-a738-bd23ef1dfd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume f99e0aaa-76fc-4cfa-9876-ad652381afa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3', 'volume_size': 1} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:51 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890 1073741824" returned: 0 in 0.518s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (b0675649-ec56-4a92-b885-d5a1f7fc85f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601fd4b2-a873-4791-b4f6-ad353b7c16d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:51 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890 Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601fd4b2-a873-4791-b4f6-ad353b7c16d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-469320756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5129a81-4aba-4ae6-b101-3550748e16ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:51Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d128b4c5-b95e-466b-8a07-cd1c187a9615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d128b4c5-b95e-466b-8a07-cd1c187a9615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf70330c-54c7-4700-b858-18c957d6bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf70330c-54c7-4700-b858-18c957d6bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5129a81-4aba-4ae6-b101-3550748e16ff', 'volume_name': 'volume-a5129a81-4aba-4ae6-b101-3550748e16ff', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c61c0a6-d64f-4612-b2bd-2380f3278ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c61c0a6-d64f-4612-b2bd-2380f3278ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754a0b50-2b2a-4a64-9d77-85685f5691ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume a5129a81-4aba-4ae6-b101-3550748e16ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5129a81-4aba-4ae6-b101-3550748e16ff', 'volume_size': 1} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:51 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337016007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66eebf4e-d690-4cce-bdbb-b28e0b86e9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:51Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Creating volume 66eebf4e-d690-4cce-bdbb-b28e0b86e9be {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:33:51 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:51 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be 1073741824 Sep 30 22:33:51 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0c0080-ef40-4842-820b-a6409c34d699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc7c016-e9ab-4632-a40c-6901482fe890', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76337d27-404b-4b91-a859-95d7f5c9e95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume volume-5dc7c016-e9ab-4632-a40c-6901482fe890 (5dc7c016-e9ab-4632-a40c-6901482fe890): created successfully Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76337d27-404b-4b91-a859-95d7f5c9e95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (89d5182f-95ca-46aa-a271-92e38f158c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8cc39d73-a062-4de0-bda5-188a38f1e7d9 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created volume successfully. Sep 30 22:33:52 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be 1073741824" returned: 0 in 0.418s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:52 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be Sep 30 22:33:52 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:52 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be" returned: 0 in 0.233s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.269s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-713674023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99e0aaa-76fc-4cfa-9876-ad652381afa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:51Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Creating volume f99e0aaa-76fc-4cfa-9876-ad652381afa3 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:33:52 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ed8af7-533f-4759-a42f-bda7bf65b3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:52 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 1073741824 Sep 30 22:33:52 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6674a8d-fd8c-4056-b075-5d6b996de14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be (66eebf4e-d690-4cce-bdbb-b28e0b86e9be): created successfully Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6674a8d-fd8c-4056-b075-5d6b996de14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (888bc663-ea54-48eb-bff0-e46f758e9037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5bb72788-6847-42b8-ab06-2b218b3ca5b6 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created volume successfully. Sep 30 22:33:52 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 1073741824" returned: 0 in 0.404s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:52 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 Sep 30 22:33:52 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:52 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.567s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-469320756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5129a81-4aba-4ae6-b101-3550748e16ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b1041fae2b4ab0a2fa51a6ef749da7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:33:51Z,use_quota=True,user_id='a091a0b5ff4d463b8f513088a9dcea04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Creating volume a5129a81-4aba-4ae6-b101-3550748e16ff {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:33:53 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1115016-721d-4525-a738-bd23ef1dfd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:53 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff 1073741824 Sep 30 22:33:53 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851da1dc-d74a-4cfe-b749-a3152c042920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 (f99e0aaa-76fc-4cfa-9876-ad652381afa3): created successfully Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (851da1dc-d74a-4cfe-b749-a3152c042920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (41e2eaef-21ae-4f85-b804-bdf26469d37a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-33d628fd-37ba-47a2-a535-59b0bd5bc861 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created volume successfully. Sep 30 22:33:53 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff 1073741824" returned: 0 in 0.418s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:53 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff Sep 30 22:33:53 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:53 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754a0b50-2b2a-4a64-9d77-85685f5691ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5129a81-4aba-4ae6-b101-3550748e16ff', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fe8aef-c453-4644-84f5-55ad3eec8769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:33:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Volume volume-a5129a81-4aba-4ae6-b101-3550748e16ff (a5129a81-4aba-4ae6-b101-3550748e16ff): created successfully Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fe8aef-c453-4644-84f5-55ad3eec8769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:33:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Flow 'volume_create_manager' (b0675649-ec56-4a92-b885-d5a1f7fc85f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:33:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bbde169b-94e2-45e5-963d-e449c3140510 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created volume successfully. Sep 30 22:33:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-a5129a81-4aba-4ae6-b101-3550748e16ff-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-a5129a81-4aba-4ae6-b101-3550748e16ff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-quobyte-a5129a81-4aba-4ae6-b101-3550748e16ff" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-a5129a81-4aba-4ae6-b101-3550748e16ff" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1133ed2d-8450-47a9-8512-9d022395ee77]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:33:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:54 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff Sep 30 22:33:54 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:55 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff" returned: 0 in 0.355s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:55 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff Sep 30 22:33:55 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:55 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a5129a81-4aba-4ae6-b101-3550748e16ff" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-a5129a81-4aba-4ae6-b101-3550748e16ff" released by "delete_volume" :: held 0.639s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created reservations ['86e65768-572f-4dbe-bd29-7e96675c35cc', '759667fd-eaa7-4f40-8a88-8ae8e27e8173', '79c11453-1ff1-40e4-9d31-97d86a7e3fcc', '9dd0787f-1afe-425c-84e5-5044a35fe1cc'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:55 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:33:55 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:55 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:33:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Deleted volume successfully. Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d37c730f-71b3-4577-9feb-1b4f1a56b8d0 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-a5129a81-4aba-4ae6-b101-3550748e16ff-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-f99e0aaa-76fc-4cfa-9876-ad652381afa3-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-f99e0aaa-76fc-4cfa-9876-ad652381afa3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-quobyte-f99e0aaa-76fc-4cfa-9876-ad652381afa3" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-f99e0aaa-76fc-4cfa-9876-ad652381afa3" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b030c-32e6-497c-ae79-d82070b7b400]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:56 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 Sep 30 22:33:56 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:56 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:56 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3 Sep 30 22:33:56 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:56 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f99e0aaa-76fc-4cfa-9876-ad652381afa3" returned: 0 in 0.246s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-f99e0aaa-76fc-4cfa-9876-ad652381afa3" released by "delete_volume" :: held 0.648s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created reservations ['02232bc4-51cd-4178-9009-5e63e67b5447', '93b9d919-7948-4440-975f-784aef8bf1de', '8552519a-7040-49e3-bd68-6e6ee8e7f2ff', '403db308-644d-4835-b3cb-8e0c66e219ab'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:56 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:33:56 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:56 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:33:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Deleted volume successfully. Sep 30 22:33:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2530d83-0d8f-46c9-8516-df7cc4679954 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-f99e0aaa-76fc-4cfa-9876-ad652381afa3-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-66eebf4e-d690-4cce-bdbb-b28e0b86e9be-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-66eebf4e-d690-4cce-bdbb-b28e0b86e9be-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-quobyte-66eebf4e-d690-4cce-bdbb-b28e0b86e9be" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-66eebf4e-d690-4cce-bdbb-b28e0b86e9be" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2061be72-c3ee-4b17-8d04-29f20ba2b38f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:57 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be Sep 30 22:33:57 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:57 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be" returned: 0 in 0.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:57 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be Sep 30 22:33:57 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:57 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-66eebf4e-d690-4cce-bdbb-b28e0b86e9be" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-66eebf4e-d690-4cce-bdbb-b28e0b86e9be" released by "delete_volume" :: held 0.630s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created reservations ['4c52ee9b-01b2-4bc9-af1b-319fa34ca265', 'be2ff9de-18b9-4407-a13f-4657b9e6adb8', '2824ff78-6c24-480e-a1d2-24c0bb9412b9', '3d15ef19-b165-46b4-bf85-087780434c48'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:57 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:33:57 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:58 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.263s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:33:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Deleted volume successfully. Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-18b04190-8598-406e-be24-418502b234cb tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-66eebf4e-d690-4cce-bdbb-b28e0b86e9be-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-5dc7c016-e9ab-4632-a40c-6901482fe890-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-5dc7c016-e9ab-4632-a40c-6901482fe890-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-quobyte-5dc7c016-e9ab-4632-a40c-6901482fe890" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-5dc7c016-e9ab-4632-a40c-6901482fe890" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777444e-e109-4c84-b791-49fe6ad74231]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:58 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890 Sep 30 22:33:58 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:58 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:58 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890 Sep 30 22:33:58 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:58 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dc7c016-e9ab-4632-a40c-6901482fe890" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-5dc7c016-e9ab-4632-a40c-6901482fe890" released by "delete_volume" :: held 0.643s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:58 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created reservations ['f759cc7f-755c-498e-88f6-c3a797be8d01', '5f8a4bc5-47eb-44bf-b299-95b5e766d2b2', 'd711d66c-74cb-4258-a256-d92f96252580', 'd7d1b839-4625-4ce3-a09f-e6a1779239d1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:59 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:33:59 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:59 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:33:59 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Deleted volume successfully. Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e637b06c-cbb0-4b92-961a-8f53af6c3979 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-5dc7c016-e9ab-4632-a40c-6901482fe890-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-82a1179b-b33a-474a-b280-e77ff7029500-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-82a1179b-b33a-474a-b280-e77ff7029500-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-quobyte-82a1179b-b33a-474a-b280-e77ff7029500" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-82a1179b-b33a-474a-b280-e77ff7029500" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4e115c-7826-4466-84b4-9789ebeac87b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:59 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500 Sep 30 22:33:59 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:33:59 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500" returned: 0 in 0.341s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:33:59 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500 Sep 30 22:33:59 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:00 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-82a1179b-b33a-474a-b280-e77ff7029500" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-82a1179b-b33a-474a-b280-e77ff7029500" released by "delete_volume" :: held 0.620s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created reservations ['d63298f0-0bc7-4d2a-83ac-55273e182a90', '095fdc15-b7ec-4ad9-8052-a4dfee8f59b4', '95d5fb23-067e-4aa8-a0ed-acc5cc194425', 'e552c5a2-8ced-494f-8adf-73239da7fda1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:00 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:00 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:00 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Deleted volume successfully. Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7c17932d-b92a-40d2-bd91-02a341bfc255 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-82a1179b-b33a-474a-b280-e77ff7029500-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-04c13d4a-10ba-4b0d-beea-c57acc72c954-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-04c13d4a-10ba-4b0d-beea-c57acc72c954-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "cinder-quobyte-04c13d4a-10ba-4b0d-beea-c57acc72c954" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-04c13d4a-10ba-4b0d-beea-c57acc72c954" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a91cd-3c8a-489a-a251-e3a538047374]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:00 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 Sep 30 22:34:00 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:00 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:00 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954 Sep 30 22:34:00 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:01 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-04c13d4a-10ba-4b0d-beea-c57acc72c954" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-quobyte-04c13d4a-10ba-4b0d-beea-c57acc72c954" released by "delete_volume" :: held 0.642s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Created reservations ['acb07eb6-4cff-4fb8-b775-ab64bc110a85', '61bd67cd-c2df-42d3-89d1-1ddce249a601', 'ce89994d-5041-4418-a2cb-c362ea46e38c', '5f2764eb-02d3-4a7e-9122-7469940442df'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:01 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:01 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:01 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Deleted volume successfully. Sep 30 22:34:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-377b8527-07a1-4602-a029-14af6adf1503 tempest-CreateVolumesFromSourceVolumeTest-1984854686 None] Lock "cinder-04c13d4a-10ba-4b0d-beea-c57acc72c954-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:03 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:03 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:03 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.260s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:34:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Flow 'volume_create_manager' (5c487b85-269f-4c32-b1bc-e74bef807bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a0de60-f189-4a1c-ba3d-9ca83faa1517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a0de60-f189-4a1c-ba3d-9ca83faa1517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277845758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9a2521-d224-4b98-b35b-01282b7059c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b7b9a4560b4b22ae95e555fd9e5383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:05Z,use_quota=True,user_id='5bf1ea8345db4dd28d9c5c29d1fbb030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab05ae7-c60f-4d47-a7b0-477a2b6e264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab05ae7-c60f-4d47-a7b0-477a2b6e264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e5eb88-3932-4f99-8b3c-d7cf70867399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e5eb88-3932-4f99-8b3c-d7cf70867399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9a2521-d224-4b98-b35b-01282b7059c1', 'volume_name': 'volume-9c9a2521-d224-4b98-b35b-01282b7059c1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4169785c-ae77-4b05-b599-ef8c19e59c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4169785c-ae77-4b05-b599-ef8c19e59c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bfd8f4-ec46-4ce1-9133-3ab7708778c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Volume 9c9a2521-d224-4b98-b35b-01282b7059c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9a2521-d224-4b98-b35b-01282b7059c1', 'volume_size': 1} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1277845758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9a2521-d224-4b98-b35b-01282b7059c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b7b9a4560b4b22ae95e555fd9e5383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:05Z,use_quota=True,user_id='5bf1ea8345db4dd28d9c5c29d1fbb030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Creating volume 9c9a2521-d224-4b98-b35b-01282b7059c1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:05 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:05 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1 1073741824 Sep 30 22:34:05 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:05 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1 1073741824" returned: 0 in 0.420s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:05 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1 Sep 30 22:34:05 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:05 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bfd8f4-ec46-4ce1-9133-3ab7708778c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9a2521-d224-4b98-b35b-01282b7059c1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6e36e1-9f84-4d2e-9811-3ad61287c57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Volume volume-9c9a2521-d224-4b98-b35b-01282b7059c1 (9c9a2521-d224-4b98-b35b-01282b7059c1): created successfully Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6e36e1-9f84-4d2e-9811-3ad61287c57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Flow 'volume_create_manager' (5c487b85-269f-4c32-b1bc-e74bef807bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-82f74901-e87b-423b-abcf-1dd9c771e331 tempest-ProjectReaderTests-440798423 None] Created volume successfully. Sep 30 22:34:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Acquiring lock "cinder-9c9a2521-d224-4b98-b35b-01282b7059c1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Lock "cinder-9c9a2521-d224-4b98-b35b-01282b7059c1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Acquiring lock "cinder-quobyte-9c9a2521-d224-4b98-b35b-01282b7059c1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Lock "cinder-quobyte-9c9a2521-d224-4b98-b35b-01282b7059c1" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c94f72-84c3-4a25-bbb2-6bbc23edcdeb]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:06 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1 Sep 30 22:34:06 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:06 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1" returned: 0 in 0.363s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:06 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1 Sep 30 22:34:06 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:07 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9c9a2521-d224-4b98-b35b-01282b7059c1" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Lock "cinder-quobyte-9c9a2521-d224-4b98-b35b-01282b7059c1" released by "delete_volume" :: held 0.649s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Created reservations ['710cbb60-f934-476b-848d-5a1c72be9a4e', 'cc5e6d5b-7336-48bd-a43d-ffdde47ebd36', '9a02a604-c847-409d-bb08-a14cdad55c94', 'dc03b1a8-a160-440f-ac25-932b99fb4f01'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:07 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:07 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:07 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.251s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Deleted volume successfully. Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ab13261f-1968-4d9f-a641-549e17a00b90 tempest-ProjectReaderTests-440798423 None] Lock "cinder-9c9a2521-d224-4b98-b35b-01282b7059c1-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Flow 'volume_create_manager' (b21c5e6a-99c5-4b53-b1ed-8f225ff0ea24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2794f28b-0298-4d06-b4f3-c9ee7d1b9fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2794f28b-0298-4d06-b4f3-c9ee7d1b9fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199049689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bd6084-844f-44fe-9cca-454d229933f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b7b9a4560b4b22ae95e555fd9e5383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:08Z,use_quota=True,user_id='5bf1ea8345db4dd28d9c5c29d1fbb030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1217a6cc-0af0-4c9e-89e1-592b184bfdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1217a6cc-0af0-4c9e-89e1-592b184bfdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ee08ca-bbd5-4338-a623-44eec12e2a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ee08ca-bbd5-4338-a623-44eec12e2a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77bd6084-844f-44fe-9cca-454d229933f4', 'volume_name': 'volume-77bd6084-844f-44fe-9cca-454d229933f4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e6a336-978f-4878-840c-1f51996f5856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e6a336-978f-4878-840c-1f51996f5856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a56845-9278-4d43-a618-7dde88270252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Volume 77bd6084-844f-44fe-9cca-454d229933f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77bd6084-844f-44fe-9cca-454d229933f4', 'volume_size': 1} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1199049689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bd6084-844f-44fe-9cca-454d229933f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b7b9a4560b4b22ae95e555fd9e5383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:08Z,use_quota=True,user_id='5bf1ea8345db4dd28d9c5c29d1fbb030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Creating volume 77bd6084-844f-44fe-9cca-454d229933f4 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:07 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:08 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4 1073741824 Sep 30 22:34:08 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:08 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4 1073741824" returned: 0 in 0.409s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:08 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4 Sep 30 22:34:08 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:08 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a56845-9278-4d43-a618-7dde88270252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77bd6084-844f-44fe-9cca-454d229933f4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9c97eb-b4b4-420a-8beb-f6dc08402c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Volume volume-77bd6084-844f-44fe-9cca-454d229933f4 (77bd6084-844f-44fe-9cca-454d229933f4): created successfully Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9c97eb-b4b4-420a-8beb-f6dc08402c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Flow 'volume_create_manager' (b21c5e6a-99c5-4b53-b1ed-8f225ff0ea24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-167db8ae-62c8-440c-868f-ef02ba9b28c4 tempest-ProjectReaderTests-440798423 None] Created volume successfully. Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Acquiring lock "cinder-77bd6084-844f-44fe-9cca-454d229933f4-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Lock "cinder-77bd6084-844f-44fe-9cca-454d229933f4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Acquiring lock "cinder-quobyte-77bd6084-844f-44fe-9cca-454d229933f4" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Lock "cinder-quobyte-77bd6084-844f-44fe-9cca-454d229933f4" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d039f363-eb2b-4e33-b033-9cc8acde55e5]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:09 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4 Sep 30 22:34:09 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:09 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4" returned: 0 in 0.357s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:09 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4 Sep 30 22:34:09 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:09 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-77bd6084-844f-44fe-9cca-454d229933f4" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Lock "cinder-quobyte-77bd6084-844f-44fe-9cca-454d229933f4" released by "delete_volume" :: held 0.642s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Created reservations ['c926c2fa-59c2-4440-bb05-06bfccbfb815', '15d28e1f-2387-4adf-b81f-a401f408429d', '8fefe9dc-1ceb-4e68-b39c-799ba2b962a7', '8e726c80-3406-46ad-bf11-8aaf3988c7d2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:09 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:09 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:10 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:10 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Deleted volume successfully. Sep 30 22:34:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70eb80b3-e1ac-47da-8ed9-b0898da7e47c tempest-ProjectReaderTests-440798423 None] Lock "cinder-77bd6084-844f-44fe-9cca-454d229933f4-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=61,cinder:UPDATE=94,cinder:INSERT=21,cinder:DELETE=8 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:34:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=52,cinder:UPDATE=83,cinder:DELETE=8,cinder:INSERT=19 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (a0aeb2f0-b47a-474a-aade-9bd0682b7a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e742a467-5a7f-48c2-9f58-79e990ec251f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e742a467-5a7f-48c2-9f58-79e990ec251f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-235281200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f9de2e-b22f-4028-b7ee-14bd2d47dacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:26Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a914be2e-d422-477b-a3a3-c216e87b61c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a914be2e-d422-477b-a3a3-c216e87b61c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593ba709-0892-4a3f-bb84-ba4f1d993aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593ba709-0892-4a3f-bb84-ba4f1d993aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f9de2e-b22f-4028-b7ee-14bd2d47dacf', 'volume_name': 'volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4513d066-d90a-4485-9dbf-a8782b24ac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4513d066-d90a-4485-9dbf-a8782b24ac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e166a378-b9f6-4071-a100-409cf7364c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume 54f9de2e-b22f-4028-b7ee-14bd2d47dacf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf', 'volume_size': 1} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-235281200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f9de2e-b22f-4028-b7ee-14bd2d47dacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:26Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Creating volume 54f9de2e-b22f-4028-b7ee-14bd2d47dacf {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:26 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:26 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf 1073741824 Sep 30 22:34:26 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (703d32c5-b192-4a61-83fc-7b0e70beaa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3448856-1250-41f2-896f-8f8a4c626c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3448856-1250-41f2-896f-8f8a4c626c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-641600023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541016f8-72a3-434a-9dfa-9fa341ced45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:27Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8821717c-819e-43f2-8ca3-0d98c9f09c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8821717c-819e-43f2-8ca3-0d98c9f09c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0adf141c-7396-414f-96a5-44003a0e39fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0adf141c-7396-414f-96a5-44003a0e39fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541016f8-72a3-434a-9dfa-9fa341ced45e', 'volume_name': 'volume-541016f8-72a3-434a-9dfa-9fa341ced45e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafe0591-9a3d-49fd-8607-a4482cbc36c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafe0591-9a3d-49fd-8607-a4482cbc36c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3318a7-1f41-4d6e-bed2-68d343847a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume 541016f8-72a3-434a-9dfa-9fa341ced45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541016f8-72a3-434a-9dfa-9fa341ced45e', 'volume_size': 1} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:26 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf 1073741824" returned: 0 in 0.747s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:26 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf Sep 30 22:34:26 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:27 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-641600023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541016f8-72a3-434a-9dfa-9fa341ced45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:27Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Creating volume 541016f8-72a3-434a-9dfa-9fa341ced45e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:27 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e166a378-b9f6-4071-a100-409cf7364c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53387fef-0b0c-49b8-8f2e-90c025dc1ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:27 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e 1073741824 Sep 30 22:34:27 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf (54f9de2e-b22f-4028-b7ee-14bd2d47dacf): created successfully Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53387fef-0b0c-49b8-8f2e-90c025dc1ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (a0aeb2f0-b47a-474a-aade-9bd0682b7a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d179e20c-425c-457c-836e-0905a608929c tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created volume successfully. Sep 30 22:34:27 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e 1073741824" returned: 0 in 0.524s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:27 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e Sep 30 22:34:27 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:28 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e" returned: 0 in 0.311s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3318a7-1f41-4d6e-bed2-68d343847a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541016f8-72a3-434a-9dfa-9fa341ced45e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203b9f5a-8494-476e-a16e-05e623b87961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume volume-541016f8-72a3-434a-9dfa-9fa341ced45e (541016f8-72a3-434a-9dfa-9fa341ced45e): created successfully Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203b9f5a-8494-476e-a16e-05e623b87961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (703d32c5-b192-4a61-83fc-7b0e70beaa9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-329c772e-0271-4f89-8552-b1b08f4c11d7 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created volume successfully. Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Creating offline snapshot c7bd1830-6d04-4130-bee8-76ef9151226d of volume 54f9de2e-b22f-4028-b7ee-14bd2d47dacf {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5aeb7d-7938-4546-b501-0d0b2622051e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:28 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf Sep 30 22:34:28 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:28 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" returned: 0 in 0.448s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:28 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d 1G Sep 30 22:34:28 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (b086b57b-f405-4b75-908e-acb4f87576bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f857b0d-46b6-4e6c-83e7-807817e2ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f857b0d-46b6-4e6c-83e7-807817e2ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893558381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f99049c-7eec-4cc3-a0cf-26141aa30d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:29Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124318eb-4b55-4dd5-a305-e6d856609dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124318eb-4b55-4dd5-a305-e6d856609dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd0bb52-1ece-4851-9161-7884264f8d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd0bb52-1ece-4851-9161-7884264f8d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f99049c-7eec-4cc3-a0cf-26141aa30d51', 'volume_name': 'volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932d3c47-1603-43b0-aa3b-98337bca5a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932d3c47-1603-43b0-aa3b-98337bca5a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eeb0a79-9d65-4269-9695-11bc4a7155a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume 5f99049c-7eec-4cc3-a0cf-26141aa30d51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51', 'volume_size': 1} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:29 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d 1G" returned: 0 in 0.798s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:29 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d Sep 30 22:34:29 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (4275350b-4a58-4bdb-b2cf-aeb80c7d51a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513374ff-b4ba-42df-905a-9f3a0c23f407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513374ff-b4ba-42df-905a-9f3a0c23f407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-832131871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857208af-6198-4acd-947b-a7bb7ca8d590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:30Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3d9a7d-3e6e-45b3-b099-e072e6ce98d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3d9a7d-3e6e-45b3-b099-e072e6ce98d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a695a887-0a09-462b-988e-8533261d3ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a695a887-0a09-462b-988e-8533261d3ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857208af-6198-4acd-947b-a7bb7ca8d590', 'volume_name': 'volume-857208af-6198-4acd-947b-a7bb7ca8d590', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5ccdc0-acaa-4109-b19d-d48901fe8a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5ccdc0-acaa-4109-b19d-d48901fe8a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8189f3-0e0c-47b3-810a-1a26fb3b8e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume 857208af-6198-4acd-947b-a7bb7ca8d590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857208af-6198-4acd-947b-a7bb7ca8d590', 'volume_size': 1} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:30 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d" returned: 0 in 0.592s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:30 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d is being set with open permissions: ugo+rw Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:30 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d Sep 30 22:34:30 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Flow 'volume_create_manager' (f3e52d35-de80-4ff1-acd6-583332d75e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4e457a-8937-4bbf-adfc-ab42cce4ec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4e457a-8937-4bbf-adfc-ab42cce4ec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352868ac-5f92-4a61-91be-68aa5c77cf51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2dc116605bd418eaa2ca76764f1a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:30Z,use_quota=True,user_id='41f8850e345f4f97ab5e9915747d5b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771f645f-0993-412c-8197-1243a01f96b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771f645f-0993-412c-8197-1243a01f96b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbecebff-cb8b-462c-b546-b76d90a21f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:34:30 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (18423e2c-f6bf-4141-ace5-296fb53ebe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2d22b9-302f-4ad0-9772-af5f5c30a9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d" returned: 0 in 0.465s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2d22b9-302f-4ad0-9772-af5f5c30a9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448112338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d191d4-aa0a-4318-bd9d-0829eb358567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:31Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62595b0-b4a6-4e79-ab88-239082aa2d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62595b0-b4a6-4e79-ab88-239082aa2d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64736726-4452-40d9-b95a-e68dd46eb875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64736726-4452-40d9-b95a-e68dd46eb875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d191d4-aa0a-4318-bd9d-0829eb358567', 'volume_name': 'volume-76d191d4-aa0a-4318-bd9d-0829eb358567', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb6ad76-4605-4576-861e-86f93bdc6164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb6ad76-4605-4576-861e-86f93bdc6164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3351bf5b-f4e0-4222-96eb-47e151639673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume 76d191d4-aa0a-4318-bd9d-0829eb358567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d191d4-aa0a-4318-bd9d-0829eb358567', 'volume_size': 1} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:30 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.info Sep 30 22:34:30 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbecebff-cb8b-462c-b546-b76d90a21f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '352868ac-5f92-4a61-91be-68aa5c77cf51', 'volume_name': 'volume-352868ac-5f92-4a61-91be-68aa5c77cf51', 'volume_size': 1, 'image_id': '3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5762062e23700a7e2c5ac54159256529', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2dc116605bd418eaa2ca76764f1a63c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ad08a4685e413f9c56ab8c42c140231ba320c699e5de3ee67b7f64730556c2ae18556f2356d172081e33a6af5c4a649fac6cdd995d194858be12ed104d9f34f', 'id': '3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'created_at': datetime.datetime(2026, 9, 30, 20, 34, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 34, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e5435cb-9e23-4c14-b260-c9c1a3b89747/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de52df6-a46a-4ac3-9d67-06b7e833e7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de52df6-a46a-4ac3-9d67-06b7e833e7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ade3216-fc30-4177-a95c-46f9bfa1e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Volume 352868ac-5f92-4a61-91be-68aa5c77cf51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-352868ac-5f92-4a61-91be-68aa5c77cf51', 'volume_size': 1, 'image_id': '3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5762062e23700a7e2c5ac54159256529', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2dc116605bd418eaa2ca76764f1a63c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ad08a4685e413f9c56ab8c42c140231ba320c699e5de3ee67b7f64730556c2ae18556f2356d172081e33a6af5c4a649fac6cdd995d194858be12ed104d9f34f', 'id': '3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'created_at': datetime.datetime(2026, 9, 30, 20, 34, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 34, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e5435cb-9e23-4c14-b260-c9c1a3b89747/file', 'properties': {}}, 'image_service': } Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Trying to clone 352868ac-5f92-4a61-91be-68aa5c77cf51 from image 3e5435cb-9e23-4c14-b260-c9c1a3b89747 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (8312b0c6-e801-41da-b5c7-e9c65c815420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93502467-0465-4b96-9639-ac50f2a9af16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93502467-0465-4b96-9639-ac50f2a9af16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283129090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91240a6b-9e47-438f-b064-5c4edfdd7e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:31Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681c4f21-5c21-48f4-81da-235a40e864f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681c4f21-5c21-48f4-81da-235a40e864f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2744fe-e20b-4e8e-a29c-7d7562d09c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2744fe-e20b-4e8e-a29c-7d7562d09c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91240a6b-9e47-438f-b064-5c4edfdd7e04', 'volume_name': 'volume-91240a6b-9e47-438f-b064-5c4edfdd7e04', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f17f3da-56db-473b-bf3b-5fc718a7e0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f17f3da-56db-473b-bf3b-5fc718a7e0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504d10e1-8349-4e39-9a42-225dae500860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume 91240a6b-9e47-438f-b064-5c4edfdd7e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91240a6b-9e47-438f-b064-5c4edfdd7e04', 'volume_size': 1} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:34:31 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Image download 0.00 MB at 0.00 MB/s Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.info" returned: 0 in 0.448s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:31 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.info is being set with open permissions: ugo+rw Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:31 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.info Sep 30 22:34:31 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20e2d4a-cd45-4ebc-999a-ce432672067b]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:31 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD Sep 30 22:34:31 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:31 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.info" returned: 0 in 0.312s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.220s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.108s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893558381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f99049c-7eec-4cc3-a0cf-26141aa30d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:29Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Creating volume 5f99049c-7eec-4cc3-a0cf-26141aa30d51 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:31 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f6ad3600-35dd-467e-9cd2-478ab9c41868 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Create snapshot completed successfully Sep 30 22:34:31 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 1073741824 Sep 30 22:34:31 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:31 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (d62986f6-2845-4c07-8a34-4ddaeb50cca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6bec31-6c16-4dd9-bfa7-6313deed7b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD Sep 30 22:34:31 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6bec31-6c16-4dd9-bfa7-6313deed7b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-413420034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fccd9e-8408-4c81-94f2-d4ec01a44c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:32Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dec0912-9307-4039-b7e9-fdf7c1aca8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dec0912-9307-4039-b7e9-fdf7c1aca8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002feb43-b61c-40a3-9075-a9d3ab1ea64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002feb43-b61c-40a3-9075-a9d3ab1ea64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fccd9e-8408-4c81-94f2-d4ec01a44c8e', 'volume_name': 'volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b942c304-cb3d-4ef3-ab66-3f9463c7bc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b942c304-cb3d-4ef3-ab66-3f9463c7bc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca002aa-7d83-4a32-8b0f-2e4e77ed920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume 08fccd9e-8408-4c81-94f2-d4ec01a44c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e', 'volume_size': 1} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Flow 'volume_create_manager' (d70111ba-0dc3-43bf-9b1b-b1402e443d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3844ee0-75bf-448a-aa61-f5a16e65781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3844ee0-75bf-448a-aa61-f5a16e65781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43328400-9b01-4e46-92e6-543d362ea9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449ddccf06cf497194d1517989b135da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:32Z,use_quota=True,user_id='b796103d82c249f99395c8b1f20dd64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(652b6515-3421-446d-9cce-7f15616da238),volume_type_id=652b6515-3421-446d-9cce-7f15616da238)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d157a506-cf7c-4265-a39d-506ebadb1897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d157a506-cf7c-4265-a39d-506ebadb1897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf18278-3b53-4f77-8c75-b5856c02d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 30 22:34:32 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 1073741824" returned: 0 in 0.516s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:32 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD" returned: 1 in 0.423s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Temporary image 3e5435cb-9e23-4c14-b260-c9c1a3b89747 is fetched for user 41f8850e345f4f97ab5e9915747d5b23. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:32 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 Sep 30 22:34:32 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0619ae85-9890-456a-a702-5065791a8eb7]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf18278-3b53-4f77-8c75-b5856c02d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43328400-9b01-4e46-92e6-543d362ea9a0', 'volume_name': 'volume-43328400-9b01-4e46-92e6-543d362ea9a0', 'volume_size': 1, 'image_id': 'd81429ff-fe80-4611-97c8-04f7b190e6a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d81429ff-fe80-4611-97c8-04f7b190e6a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c371de35bfa90ad25b86960ad386ea0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '449ddccf06cf497194d1517989b135da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a78792046a0210f1ce7b8ad03da36f2761c8236cb0549ff1469a49261a2f0a0441eebcad2cdd0cc1dc55b8c4a9b5c16e33a5b5710290b1c52fa8502a826058fb', 'id': 'd81429ff-fe80-4611-97c8-04f7b190e6a9', 'created_at': datetime.datetime(2026, 9, 30, 20, 34, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 34, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d81429ff-fe80-4611-97c8-04f7b190e6a9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c50878d-ee1e-45e1-ba83-5871d650c3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c50878d-ee1e-45e1-ba83-5871d650c3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4080d3-8976-4bef-b6d4-5886944256ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Volume 43328400-9b01-4e46-92e6-543d362ea9a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43328400-9b01-4e46-92e6-543d362ea9a0', 'volume_size': 1, 'image_id': 'd81429ff-fe80-4611-97c8-04f7b190e6a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d81429ff-fe80-4611-97c8-04f7b190e6a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c371de35bfa90ad25b86960ad386ea0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '449ddccf06cf497194d1517989b135da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a78792046a0210f1ce7b8ad03da36f2761c8236cb0549ff1469a49261a2f0a0441eebcad2cdd0cc1dc55b8c4a9b5c16e33a5b5710290b1c52fa8502a826058fb', 'id': 'd81429ff-fe80-4611-97c8-04f7b190e6a9', 'created_at': datetime.datetime(2026, 9, 30, 20, 34, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 34, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d81429ff-fe80-4611-97c8-04f7b190e6a9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Trying to clone 43328400-9b01-4e46-92e6-543d362ea9a0 from image d81429ff-fe80-4611-97c8-04f7b190e6a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d81429ff-fe80-4611-97c8-04f7b190e6a9', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 30 22:34:32 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD Sep 30 22:34:32 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 30 22:34:32 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Image download 0.00 MB at 0.00 MB/s Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f336624c-43af-495e-befb-f80a9102ebe1]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:32 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51" returned: 0 in 0.508s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.657s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-832131871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857208af-6198-4acd-947b-a7bb7ca8d590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:30Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Creating volume 857208af-6198-4acd-947b-a7bb7ca8d590 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:32 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:32 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:32 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590 1073741824 Sep 30 22:34:32 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD Sep 30 22:34:32 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:32 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eeb0a79-9d65-4269-9695-11bc4a7155a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32db1df-de89-4c58-8add-9a5a5389f197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (92959f27-db1f-48bc-bf99-0a275777f334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa0b0f6-c5c1-4759-8df6-2dd21aab98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa0b0f6-c5c1-4759-8df6-2dd21aab98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828182502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f446f94-f446-4196-bbd8-e62641217dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:33Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacb38f5-9a82-4cd0-aecc-50b276c696d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bacb38f5-9a82-4cd0-aecc-50b276c696d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6838e404-3521-4762-908d-5ca3dcb9fb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6838e404-3521-4762-908d-5ca3dcb9fb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f446f94-f446-4196-bbd8-e62641217dad', 'volume_name': 'volume-5f446f94-f446-4196-bbd8-e62641217dad', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78a6d71-fce6-4184-a345-2b57de4eb3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78a6d71-fce6-4184-a345-2b57de4eb3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727b9161-59e8-4749-885b-c5c8d2ac5a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume 5f446f94-f446-4196-bbd8-e62641217dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f446f94-f446-4196-bbd8-e62641217dad', 'volume_size': 1} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 (5f99049c-7eec-4cc3-a0cf-26141aa30d51): created successfully Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32db1df-de89-4c58-8add-9a5a5389f197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (b086b57b-f405-4b75-908e-acb4f87576bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:32 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD Sep 30 22:34:32 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:33 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b36c04a9-45de-4e53-9f2d-f7c2930ff587 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created volume successfully. Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (50082527-9e4e-4aed-8d42-db7a52ef6dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1c737d-7571-4aa1-a09e-6d16a8b9e14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1c737d-7571-4aa1-a09e-6d16a8b9e14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098641024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad296d68-d8e2-4261-9fe8-12db79b05816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:33Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e857e9-2df6-4ca7-9071-e7ce6109b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e857e9-2df6-4ca7-9071-e7ce6109b74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb931001-522d-4aaa-b48a-24f97f49a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb931001-522d-4aaa-b48a-24f97f49a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad296d68-d8e2-4261-9fe8-12db79b05816', 'volume_name': 'volume-ad296d68-d8e2-4261-9fe8-12db79b05816', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e84d45e-be93-4fd6-b890-6a527c88416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e84d45e-be93-4fd6-b890-6a527c88416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe057b0c-4de1-4b80-8890-935352c776b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume ad296d68-d8e2-4261-9fe8-12db79b05816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad296d68-d8e2-4261-9fe8-12db79b05816', 'volume_size': 1} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD" returned: 0 in 0.525s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:33 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD" returned: 1 in 0.513s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:33 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD Sep 30 22:34:33 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:33 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590 1073741824" returned: 0 in 0.656s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:33 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590 Sep 30 22:34:33 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:33 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Temporary image d81429ff-fe80-4611-97c8-04f7b190e6a9 is fetched for user b796103d82c249f99395c8b1f20dd64c. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (56a55619-d8f2-4c40-8c0d-800c7471d9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e02059-9602-452c-b0ee-c3e9446de76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e128861-49a3-4819-ae07-78482f85200f]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:33 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e02059-9602-452c-b0ee-c3e9446de76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141626337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d13391-4ada-4fe5-b3ab-693cf61f398d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:34Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1d37a6-f596-442d-944c-c48c1449ef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1d37a6-f596-442d-944c-c48c1449ef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4090c7d-00e8-4152-8660-3ecf8dd83582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4090c7d-00e8-4152-8660-3ecf8dd83582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d13391-4ada-4fe5-b3ab-693cf61f398d', 'volume_name': 'volume-70d13391-4ada-4fe5-b3ab-693cf61f398d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686d624a-1e17-418a-8d0f-2de39b4a9fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686d624a-1e17-418a-8d0f-2de39b4a9fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37eddab1-c29f-474c-a5a5-2afdce263da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume 70d13391-4ada-4fe5-b3ab-693cf61f398d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d13391-4ada-4fe5-b3ab-693cf61f398d', 'volume_size': 1} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590" returned: 0 in 0.365s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448112338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d191d4-aa0a-4318-bd9d-0829eb358567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:31Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Creating volume 76d191d4-aa0a-4318-bd9d-0829eb358567 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:33 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:33 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567 1073741824 Sep 30 22:34:33 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8189f3-0e0c-47b3-810a-1a26fb3b8e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857208af-6198-4acd-947b-a7bb7ca8d590', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD Sep 30 22:34:33 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9735912f-63a1-456c-b1d7-e0ee70facf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume volume-857208af-6198-4acd-947b-a7bb7ca8d590 (857208af-6198-4acd-947b-a7bb7ca8d590): created successfully Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9735912f-63a1-456c-b1d7-e0ee70facf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (4275350b-4a58-4bdb-b2cf-aeb80c7d51a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:33 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e4e6fe81-812e-4e33-9ef3-fbcc6f3b2b10 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created volume successfully. Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (e4aab629-671b-453d-939d-939e70191249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f425c7e0-2960-4bf0-ae54-2895219c7a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f425c7e0-2960-4bf0-ae54-2895219c7a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101243911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f4b1ea-36fa-400a-bc66-3539fa090f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:34Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232041b1-d1e2-4111-a863-2d3a65cf9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232041b1-d1e2-4111-a863-2d3a65cf9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa1a620-0093-434a-b4a3-a471d8eb149e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa1a620-0093-434a-b4a3-a471d8eb149e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f4b1ea-36fa-400a-bc66-3539fa090f75', 'volume_name': 'volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b330aa2-a212-4de7-8495-1e58b5449f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b330aa2-a212-4de7-8495-1e58b5449f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d4bdcc-c115-4122-bb70-aaea32ba908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume e8f4b1ea-36fa-400a-bc66-3539fa090f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75', 'volume_size': 1} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:34 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD Sep 30 22:34:34 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:34 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567 1073741824" returned: 0 in 0.599s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (4acbfdb0-1f86-4ad9-a52c-69d12cf7684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959b9df4-9db9-468d-9590-46c28d756781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959b9df4-9db9-468d-9590-46c28d756781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1620689906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:34Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12411a53-a28a-4f11-862b-9af5af23bbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12411a53-a28a-4f11-862b-9af5af23bbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b46c97-a10a-48e8-a477-5245aa53c01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b46c97-a10a-48e8-a477-5245aa53c01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad', 'volume_name': 'volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2296d8a-05a8-4ce9-9297-5629990d5c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2296d8a-05a8-4ce9-9297-5629990d5c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451759e4-9e2c-47d8-8c8e-095ce373ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume 25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad', 'volume_size': 1} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:34 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567 Sep 30 22:34:34 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:34 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:34 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.527s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283129090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91240a6b-9e47-438f-b064-5c4edfdd7e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:31Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Creating volume 91240a6b-9e47-438f-b064-5c4edfdd7e04 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:34 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3351bf5b-f4e0-4222-96eb-47e151639673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d191d4-aa0a-4318-bd9d-0829eb358567', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 1073741824 Sep 30 22:34:34 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146f8429-8146-4b49-b8e8-205b7be27ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:34 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume volume-76d191d4-aa0a-4318-bd9d-0829eb358567 (76d191d4-aa0a-4318-bd9d-0829eb358567): created successfully Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146f8429-8146-4b49-b8e8-205b7be27ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (18423e2c-f6bf-4141-ace5-296fb53ebe8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e508dd89-1e3a-4a07-8bd3-1b528b0d663b tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created volume successfully. Sep 30 22:34:35 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 1073741824" returned: 0 in 0.454s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:35 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 Sep 30 22:34:35 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:35 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.602s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-413420034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fccd9e-8408-4c81-94f2-d4ec01a44c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f2f17b8eea4b7a93afe8d663513e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:32Z,use_quota=True,user_id='8e8f940e2c3c4472acb87be00772d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Creating volume 08fccd9e-8408-4c81-94f2-d4ec01a44c8e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:35 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:35 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e 1073741824 Sep 30 22:34:35 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504d10e1-8349-4e39-9a42-225dae500860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91240a6b-9e47-438f-b064-5c4edfdd7e04', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f62930-7ca0-4bb4-a943-1bc9317b7dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 (91240a6b-9e47-438f-b064-5c4edfdd7e04): created successfully Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f62930-7ca0-4bb4-a943-1bc9317b7dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (8312b0c6-e801-41da-b5c7-e9c65c815420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e89b7c61-9e18-4f05-98db-37fff223d306 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created volume successfully. Sep 30 22:34:35 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e 1073741824" returned: 0 in 0.438s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:36 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e Sep 30 22:34:36 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:36 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.314s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828182502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f446f94-f446-4196-bbd8-e62641217dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:33Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Creating volume 5f446f94-f446-4196-bbd8-e62641217dad {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:36 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca002aa-7d83-4a32-8b0f-2e4e77ed920c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:36 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad 1073741824 Sep 30 22:34:36 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e353d43c-e7ed-4847-95bd-5532a4132fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Volume volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e (08fccd9e-8408-4c81-94f2-d4ec01a44c8e): created successfully Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e353d43c-e7ed-4847-95bd-5532a4132fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Flow 'volume_create_manager' (d62986f6-2845-4c07-8a34-4ddaeb50cca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-54b4aadb-eeca-446f-94cc-c1a01689be80 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created volume successfully. Sep 30 22:34:36 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad 1073741824" returned: 0 in 0.432s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:36 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad Sep 30 22:34:36 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:37 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.855s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098641024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad296d68-d8e2-4261-9fe8-12db79b05816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:33Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Creating volume ad296d68-d8e2-4261-9fe8-12db79b05816 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:37 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727b9161-59e8-4749-885b-c5c8d2ac5a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f446f94-f446-4196-bbd8-e62641217dad', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:37 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816 1073741824 Sep 30 22:34:37 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2776663-21c6-4c20-a1f8-b0b10288c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:37 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume volume-5f446f94-f446-4196-bbd8-e62641217dad (5f446f94-f446-4196-bbd8-e62641217dad): created successfully Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2776663-21c6-4c20-a1f8-b0b10288c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (92959f27-db1f-48bc-bf99-0a275777f334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9fcbb69e-7f78-4fea-88f5-0932ba1ccb42 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created volume successfully. Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-08fccd9e-8408-4c81-94f2-d4ec01a44c8e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-08fccd9e-8408-4c81-94f2-d4ec01a44c8e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-quobyte-08fccd9e-8408-4c81-94f2-d4ec01a44c8e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-08fccd9e-8408-4c81-94f2-d4ec01a44c8e" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[941aacfb-fb00-429d-bed5-47fa447afbe5]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:37 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e Sep 30 22:34:37 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:37 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816 1073741824" returned: 0 in 0.471s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:37 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816 Sep 30 22:34:37 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:37 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e" returned: 0 in 0.371s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:37 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e Sep 30 22:34:37 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:37 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816" returned: 0 in 0.275s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.517s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352868ac-5f92-4a61-91be-68aa5c77cf51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2dc116605bd418eaa2ca76764f1a63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:30Z,use_quota=True,user_id='41f8850e345f4f97ab5e9915747d5b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Creating volume 352868ac-5f92-4a61-91be-68aa5c77cf51 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:37 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe057b0c-4de1-4b80-8890-935352c776b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad296d68-d8e2-4261-9fe8-12db79b05816', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c758546-d0cc-40d6-869a-5779de0cb82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:37 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 1073741824 Sep 30 22:34:37 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:37 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume volume-ad296d68-d8e2-4261-9fe8-12db79b05816 (ad296d68-d8e2-4261-9fe8-12db79b05816): created successfully Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c758546-d0cc-40d6-869a-5779de0cb82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (50082527-9e4e-4aed-8d42-db7a52ef6dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-137f21f5-1435-47cd-bceb-9ff315f43451 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created volume successfully. Sep 30 22:34:37 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-08fccd9e-8408-4c81-94f2-d4ec01a44c8e" returned: 0 in 0.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-08fccd9e-8408-4c81-94f2-d4ec01a44c8e" released by "delete_volume" :: held 0.669s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created reservations ['d251eb56-9bc5-41e8-980c-9ca87145e8cb', '6466dd53-adef-49b5-8a78-06a2850ccb04', 'b8ba9d8b-07a2-4d5e-902c-b047c8d96b3e', '6936e509-57e7-4e41-98bf-9ac7375531f9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:38 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:38 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:38 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 1073741824" returned: 0 in 0.459s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:38 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 Sep 30 22:34:38 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:38 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Deleted volume successfully. Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-91240a6b-9e47-438f-b064-5c4edfdd7e04-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8d9b7506-73e4-44a4-8d3a-f3e0f5c0cdb2 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-08fccd9e-8408-4c81-94f2-d4ec01a44c8e-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-91240a6b-9e47-438f-b064-5c4edfdd7e04-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-quobyte-91240a6b-9e47-438f-b064-5c4edfdd7e04" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-91240a6b-9e47-438f-b064-5c4edfdd7e04" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad737dc-5003-4dbd-b077-7f402f3de5fe]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:38 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51" returned: 0 in 0.277s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.803s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141626337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d13391-4ada-4fe5-b3ab-693cf61f398d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:34Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Creating volume 70d13391-4ada-4fe5-b3ab-693cf61f398d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:38 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:38 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 Sep 30 22:34:38 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Attempting download of 3e5435cb-9e23-4c14-b260-c9c1a3b89747 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'metadata': {}}])) to volume 352868ac-5f92-4a61-91be-68aa5c77cf51. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:34:38 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d 1073741824 Sep 30 22:34:38 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b929a0f-ae42-40c8-b743-13f6e95ba456]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e5435cb-9e23-4c14-b260-c9c1a3b89747_gegimwn_ {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:38 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e5435cb-9e23-4c14-b260-c9c1a3b89747_gegimwn_ Sep 30 22:34:38 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:38 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04" returned: 0 in 0.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:38 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04 Sep 30 22:34:38 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:39 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3e5435cb-9e23-4c14-b260-c9c1a3b89747_gegimwn_" returned: 0 in 0.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e5435cb-9e23-4c14-b260-c9c1a3b89747_gegimwn_ {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:39 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d 1073741824" returned: 0 in 0.513s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:39 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d Sep 30 22:34:39 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:39 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:39 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e5435cb-9e23-4c14-b260-c9c1a3b89747_gegimwn_ Sep 30 22:34:39 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-91240a6b-9e47-438f-b064-5c4edfdd7e04" returned: 0 in 0.296s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-91240a6b-9e47-438f-b064-5c4edfdd7e04" released by "delete_volume" :: held 0.748s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created reservations ['5a28088d-86be-4c78-bdde-4bfeaae5e8e9', 'bf983028-e614-4215-9d3f-b95e514ed19d', 'f37ba68b-2508-4986-9ea0-df0746939e96', '5b375332-565d-43ec-b96c-da1844ac93bf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:39 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:39 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:39 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d" returned: 0 in 0.272s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:39 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.190s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101243911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f4b1ea-36fa-400a-bc66-3539fa090f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:34Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Creating volume e8f4b1ea-36fa-400a-bc66-3539fa090f75 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:39 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e5435cb-9e23-4c14-b260-c9c1a3b89747_gegimwn_" returned: 1 in 0.413s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3e5435cb-9e23-4c14-b260-c9c1a3b89747_gegimwn_' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2fc714-fd67-450c-8a55-343f19f84d83]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:39 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 1073741824 Sep 30 22:34:39 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37eddab1-c29f-474c-a5a5-2afdce263da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d13391-4ada-4fe5-b3ab-693cf61f398d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a85009-5254-4711-a2f1-7ab40486a9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume volume-70d13391-4ada-4fe5-b3ab-693cf61f398d (70d13391-4ada-4fe5-b3ab-693cf61f398d): created successfully Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a85009-5254-4711-a2f1-7ab40486a9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (56a55619-d8f2-4c40-8c0d-800c7471d9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c7260df7-b006-4026-a4d1-ecc2e7c51725 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created volume successfully. Sep 30 22:34:39 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD Sep 30 22:34:39 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-76d191d4-aa0a-4318-bd9d-0829eb358567-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-76d191d4-aa0a-4318-bd9d-0829eb358567-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-quobyte-76d191d4-aa0a-4318-bd9d-0829eb358567" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-76d191d4-aa0a-4318-bd9d-0829eb358567" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:39 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Deleted volume successfully. Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c286792-8cff-472e-9042-788da77d579e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e38f24-273f-4e14-88ce-fdcfdff0cae4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-91240a6b-9e47-438f-b064-5c4edfdd7e04-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:39 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:39 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567 Sep 30 22:34:39 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:40 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD Sep 30 22:34:40 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:40 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 1073741824" returned: 0 in 0.587s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:40 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 Sep 30 22:34:40 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:40 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567" returned: 0 in 0.448s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:40 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] 3e5435cb-9e23-4c14-b260-c9c1a3b89747 was raw, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:34:40 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567 Sep 30 22:34:40 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:40 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 Sep 30 22:34:40 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:40 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75" returned: 0 in 0.295s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.856s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1620689906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c836459b9f8451b8654d0dacf3589a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:34Z,use_quota=True,user_id='91278abe1eef46b7850d7322c05d11ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Creating volume 25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d4bdcc-c115-4122-bb70-aaea32ba908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:40 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad 1073741824 Sep 30 22:34:40 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c1dada-b5e9-472e-9904-8b54173e5aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 (e8f4b1ea-36fa-400a-bc66-3539fa090f75): created successfully Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c1dada-b5e9-472e-9904-8b54173e5aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (e4aab629-671b-453d-939d-939e70191249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4b5f3593-e25b-4ec7-98b6-fe1f1c6c1132 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created volume successfully. Sep 30 22:34:40 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-76d191d4-aa0a-4318-bd9d-0829eb358567" returned: 0 in 0.290s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-76d191d4-aa0a-4318-bd9d-0829eb358567" released by "delete_volume" :: held 0.829s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created reservations ['07d95139-a74d-4b0b-ad5d-48d2af41eb5a', '576f7c7f-4185-4600-9a36-9a0d2823d739', '13e76f1d-0716-455d-b9fe-6c26e2bfa3b0', 'bb921e74-255e-4add-b0ba-6eba27796197'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:40 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:40 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:40 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51" returned: 0 in 0.527s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3e5435cb-9e23-4c14-b260-c9c1a3b89747_8bn0794idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:34:40 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:40 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 1G Sep 30 22:34:40 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-857208af-6198-4acd-947b-a7bb7ca8d590-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-857208af-6198-4acd-947b-a7bb7ca8d590-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-quobyte-857208af-6198-4acd-947b-a7bb7ca8d590" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-857208af-6198-4acd-947b-a7bb7ca8d590" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:40 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad 1073741824" returned: 0 in 0.591s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d11356-80fe-4789-8575-7cb3ea8bf32c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:41 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Deleted volume successfully. Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb4f2029-9292-43c8-96d9-d86d117330e8 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-76d191d4-aa0a-4318-bd9d-0829eb358567-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:41 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad Sep 30 22:34:41 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:41 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590 Sep 30 22:34:41 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:41 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 1G" returned: 0 in 0.410s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Downloaded image 3e5435cb-9e23-4c14-b260-c9c1a3b89747 ((None, [{'url': 'file:///opt/stack/data/glance/images/3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'metadata': {}}])) to volume 352868ac-5f92-4a61-91be-68aa5c77cf51 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Temporary image 3e5435cb-9e23-4c14-b260-c9c1a3b89747 for user 41f8850e345f4f97ab5e9915747d5b23 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Marking volume 352868ac-5f92-4a61-91be-68aa5c77cf51 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Copying metadata from image 3e5435cb-9e23-4c14-b260-c9c1a3b89747 to 352868ac-5f92-4a61-91be-68aa5c77cf51. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Creating volume glance metadata for volume 352868ac-5f92-4a61-91be-68aa5c77cf51 backed by image 3e5435cb-9e23-4c14-b260-c9c1a3b89747 with: {'image_id': '3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5762062e23700a7e2c5ac54159256529', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ade3216-fc30-4177-a95c-46f9bfa1e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352868ac-5f92-4a61-91be-68aa5c77cf51', 'volume_size': 1, 'image_id': '3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5762062e23700a7e2c5ac54159256529', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2dc116605bd418eaa2ca76764f1a63c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ad08a4685e413f9c56ab8c42c140231ba320c699e5de3ee67b7f64730556c2ae18556f2356d172081e33a6af5c4a649fac6cdd995d194858be12ed104d9f34f', 'id': '3e5435cb-9e23-4c14-b260-c9c1a3b89747', 'created_at': datetime.datetime(2026, 9, 30, 20, 34, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 34, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3e5435cb-9e23-4c14-b260-c9c1a3b89747/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fe825a-94e5-4364-9b74-070af278072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Volume volume-352868ac-5f92-4a61-91be-68aa5c77cf51 (352868ac-5f92-4a61-91be-68aa5c77cf51): created successfully Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fe825a-94e5-4364-9b74-070af278072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Flow 'volume_create_manager' (f3e52d35-de80-4ff1-acd6-583332d75e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:41 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-64665093-1a25-45a3-80aa-eab20982ebab tempest-VolumeImageDependencyTests-1784063550 None] Created volume successfully. Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad" returned: 0 in 0.309s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.781s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43328400-9b01-4e46-92e6-543d362ea9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449ddccf06cf497194d1517989b135da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:32Z,use_quota=True,user_id='b796103d82c249f99395c8b1f20dd64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(652b6515-3421-446d-9cce-7f15616da238),volume_type_id=652b6515-3421-446d-9cce-7f15616da238)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Creating volume 43328400-9b01-4e46-92e6-543d362ea9a0 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:41 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451759e4-9e2c-47d8-8c8e-095ce373ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7a7010-acdc-4231-93e9-fa66838596fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:41 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 1073741824 Sep 30 22:34:41 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Volume volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad (25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad): created successfully Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7a7010-acdc-4231-93e9-fa66838596fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Flow 'volume_create_manager' (4acbfdb0-1f86-4ad9-a52c-69d12cf7684c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e8f5327c-835f-4150-8308-9499015f340a tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created volume successfully. Sep 30 22:34:41 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590" returned: 0 in 0.477s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:41 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590 Sep 30 22:34:41 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:41 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-857208af-6198-4acd-947b-a7bb7ca8d590" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-857208af-6198-4acd-947b-a7bb7ca8d590" released by "delete_volume" :: held 0.815s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created reservations ['f100fca1-429b-4b25-9fd4-b2bbdcf5db6e', 'c5a75555-bf2d-44b9-aebe-bd6b4f72d63f', '607fb69d-eb71-43da-a7b9-99ce5e29c317', '41cfd4a6-eaf9-4b44-accf-8ae982917552'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:41 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 1073741824" returned: 0 in 0.429s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:41 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 Sep 30 22:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:41 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:41 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:41 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-5f99049c-7eec-4cc3-a0cf-26141aa30d51-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-5f99049c-7eec-4cc3-a0cf-26141aa30d51-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-quobyte-5f99049c-7eec-4cc3-a0cf-26141aa30d51" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:42 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0" returned: 0 in 0.316s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-5f99049c-7eec-4cc3-a0cf-26141aa30d51" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:42 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6487d2-75c6-45e5-9809-853be58766d9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.336s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Deleted volume successfully. Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Attempting download of d81429ff-fe80-4611-97c8-04f7b190e6a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d81429ff-fe80-4611-97c8-04f7b190e6a9', 'metadata': {}}])) to volume 43328400-9b01-4e46-92e6-543d362ea9a0. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdab95f8-4718-4524-b08f-583a53acb085 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-857208af-6198-4acd-947b-a7bb7ca8d590-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cd44c5-9583-4ea8-a424-bcaec9fb2e68]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-quobyte-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d81429ff-fe80-4611-97c8-04f7b190e6a9_fp2f2oak {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:42 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 Sep 30 22:34:42 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad" acquired by "delete_volume" :: waited 0.043s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de10b87-4049-4c1f-86bf-13b593e73b50]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:42 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d81429ff-fe80-4611-97c8-04f7b190e6a9_fp2f2oak Sep 30 22:34:42 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:42 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad Sep 30 22:34:42 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Acquiring lock "cinder-352868ac-5f92-4a61-91be-68aa5c77cf51-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Lock "cinder-352868ac-5f92-4a61-91be-68aa5c77cf51-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Acquiring lock "cinder-quobyte-352868ac-5f92-4a61-91be-68aa5c77cf51" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Lock "cinder-quobyte-352868ac-5f92-4a61-91be-68aa5c77cf51" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:42 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51" returned: 0 in 0.515s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea9e8fd-b76a-4750-bc64-813e04e67f47]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:42 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51 Sep 30 22:34:42 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:42 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d81429ff-fe80-4611-97c8-04f7b190e6a9_fp2f2oak" returned: 0 in 0.439s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d81429ff-fe80-4611-97c8-04f7b190e6a9_fp2f2oak {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:42 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 Sep 30 22:34:42 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:42 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad" returned: 0 in 0.451s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:42 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d81429ff-fe80-4611-97c8-04f7b190e6a9_fp2f2oak Sep 30 22:34:42 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:42 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad Sep 30 22:34:42 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:43 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f99049c-7eec-4cc3-a0cf-26141aa30d51" returned: 0 in 0.288s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-5f99049c-7eec-4cc3-a0cf-26141aa30d51" released by "delete_volume" :: held 0.864s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created reservations ['99d09696-865e-46c2-8698-92b685e7dced', '5eff4c62-0d37-4f6a-af01-a161d4a4c91d', '6ec3d4de-7dcd-4fb6-8a78-1fe907a0cd6c', 'b8edef7a-8e4e-46f5-82ca-ea20716b5f00'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:43 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d81429ff-fe80-4611-97c8-04f7b190e6a9_fp2f2oak" returned: 1 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d81429ff-fe80-4611-97c8-04f7b190e6a9_fp2f2oak' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2061ed-6ab9-4434-b879-34f97c4cf765]: (4, 'raw') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:43 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:43 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51" returned: 0 in 0.446s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:43 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51 Sep 30 22:34:43 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad" returned: 0 in 0.352s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad" released by "delete_volume" :: held 0.878s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-541016f8-72a3-434a-9dfa-9fa341ced45e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:43 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:43 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:43 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD Sep 30 22:34:43 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-541016f8-72a3-434a-9dfa-9fa341ced45e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "cinder-quobyte-541016f8-72a3-434a-9dfa-9fa341ced45e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created reservations ['0f51e57f-52e3-47d7-bf95-f2f667617802', '77225c8d-1a40-41bf-97c3-db85aa2939f8', '7e261e67-6e7c-44f4-9ed5-432b8c6dd47b', 'd860462b-03ee-4b99-98a5-e76d5a92c84f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-541016f8-72a3-434a-9dfa-9fa341ced45e" acquired by "delete_volume" :: waited 0.046s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f105b7b7-2b95-4836-bc84-1107298e0a84]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:43 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:43 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:43 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-352868ac-5f92-4a61-91be-68aa5c77cf51" returned: 0 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:43 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e Sep 30 22:34:43 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Lock "cinder-quobyte-352868ac-5f92-4a61-91be-68aa5c77cf51" released by "delete_volume" :: held 0.940s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:43 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD" returned: 0 in 0.518s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:43 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.491s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Deleted volume successfully. Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Created reservations ['8d12cd00-2caa-4985-af0e-1592310f80e5', '2a7bfff5-8665-4e33-ba31-68b60891fdb4', '53ed86a9-5be7-47a4-a732-44d1258ead08', '856a3c66-6e3d-4a69-9ddb-7d91050c831c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f2537811-b253-4684-8e65-ae0c014742b4 tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-5f99049c-7eec-4cc3-a0cf-26141aa30d51-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:43 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD Sep 30 22:34:43 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:43 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:43 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:43 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.344s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Deleted volume successfully. Sep 30 22:34:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c1772ddb-5627-4670-92f6-373b0aca8560 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-25a2f471-9c6d-4b62-b8d3-b29c0df8d6ad-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:44 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e" returned: 0 in 0.516s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:44 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e Sep 30 22:34:44 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:44 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD" returned: 1 in 0.437s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] d81429ff-fe80-4611-97c8-04f7b190e6a9 was raw, converting to qcow2 {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 30 22:34:44 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.295s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Deleted volume successfully. Sep 30 22:34:44 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 Sep 30 22:34:44 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f219a64e-6bbe-487a-bd34-5ede09a3e467 tempest-VolumeImageDependencyTests-1784063550 None] Lock "cinder-352868ac-5f92-4a61-91be-68aa5c77cf51-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:44 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-541016f8-72a3-434a-9dfa-9fa341ced45e" returned: 0 in 0.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-quobyte-541016f8-72a3-434a-9dfa-9fa341ced45e" released by "delete_volume" :: held 0.867s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Created reservations ['0c5f79a3-d408-4eb1-9197-95fc5acd8aa9', '832ae312-ad4f-4fef-948e-0e731cad1c1f', 'd6eb1364-4943-406c-b3ed-a139aa7a4054', 'fcf1a251-5cd1-47d8-8285-ba51007ed900'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:44 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:44 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-e8f4b1ea-36fa-400a-bc66-3539fa090f75-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-e8f4b1ea-36fa-400a-bc66-3539fa090f75-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-quobyte-e8f4b1ea-36fa-400a-bc66-3539fa090f75" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:44 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-e8f4b1ea-36fa-400a-bc66-3539fa090f75" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.323s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:44 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0" returned: 0 in 0.599s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d81429ff-fe80-4611-97c8-04f7b190e6a9_tglgg7b8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:34:44 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Converted 0.00 MB image at 0.00 MB/s Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40de719-671e-4073-aae9-dee157a401ae]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Deleted volume successfully. Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:44 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 1G Sep 30 22:34:44 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22a6d926-3487-4fae-b2b5-0d04314a170a tempest-CreateVolumesFromSourceVolumeTest-1380731134 None] Lock "cinder-541016f8-72a3-434a-9dfa-9fa341ced45e-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:44 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 Sep 30 22:34:44 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:45 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 1G" returned: 0 in 0.425s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Downloaded image d81429ff-fe80-4611-97c8-04f7b190e6a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/d81429ff-fe80-4611-97c8-04f7b190e6a9', 'metadata': {}}])) to volume 43328400-9b01-4e46-92e6-543d362ea9a0 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Temporary image d81429ff-fe80-4611-97c8-04f7b190e6a9 for user b796103d82c249f99395c8b1f20dd64c is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Marking volume 43328400-9b01-4e46-92e6-543d362ea9a0 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 30 22:34:45 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75" returned: 0 in 0.418s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Copying metadata from image d81429ff-fe80-4611-97c8-04f7b190e6a9 to 43328400-9b01-4e46-92e6-543d362ea9a0. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Creating volume glance metadata for volume 43328400-9b01-4e46-92e6-543d362ea9a0 backed by image d81429ff-fe80-4611-97c8-04f7b190e6a9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd81429ff-fe80-4611-97c8-04f7b190e6a9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2c371de35bfa90ad25b86960ad386ea0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 30 22:34:45 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75 Sep 30 22:34:45 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4080d3-8976-4bef-b6d4-5886944256ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43328400-9b01-4e46-92e6-543d362ea9a0', 'volume_size': 1, 'image_id': 'd81429ff-fe80-4611-97c8-04f7b190e6a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d81429ff-fe80-4611-97c8-04f7b190e6a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c371de35bfa90ad25b86960ad386ea0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '449ddccf06cf497194d1517989b135da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a78792046a0210f1ce7b8ad03da36f2761c8236cb0549ff1469a49261a2f0a0441eebcad2cdd0cc1dc55b8c4a9b5c16e33a5b5710290b1c52fa8502a826058fb', 'id': 'd81429ff-fe80-4611-97c8-04f7b190e6a9', 'created_at': datetime.datetime(2026, 9, 30, 20, 34, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 30, 20, 34, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d81429ff-fe80-4611-97c8-04f7b190e6a9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e271c04-ebc0-409d-808a-43d5bdd53dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:45 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Volume volume-43328400-9b01-4e46-92e6-543d362ea9a0 (43328400-9b01-4e46-92e6-543d362ea9a0): created successfully Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e271c04-ebc0-409d-808a-43d5bdd53dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Flow 'volume_create_manager' (d70111ba-0dc3-43bf-9b1b-b1402e443d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-07ee19bd-80cf-4b94-a740-84b55ab72e3e tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Created volume successfully. Sep 30 22:34:45 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e8f4b1ea-36fa-400a-bc66-3539fa090f75" returned: 0 in 0.350s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-e8f4b1ea-36fa-400a-bc66-3539fa090f75" released by "delete_volume" :: held 0.837s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created reservations ['53fecd80-2d28-4576-b52b-298456cf8e45', '6a222fd4-86ab-489f-a005-2d3dbdee374a', 'a584d842-d7bb-474e-95b0-fc086ff75d1b', '230d9422-0170-4528-b5d3-94cea5844a00'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:45 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:45 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Acquiring lock "cinder-43328400-9b01-4e46-92e6-543d362ea9a0-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-70d13391-4ada-4fe5-b3ab-693cf61f398d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-70d13391-4ada-4fe5-b3ab-693cf61f398d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "cinder-43328400-9b01-4e46-92e6-543d362ea9a0-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Acquiring lock "cinder-quobyte-43328400-9b01-4e46-92e6-543d362ea9a0" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-quobyte-70d13391-4ada-4fe5-b3ab-693cf61f398d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "cinder-quobyte-43328400-9b01-4e46-92e6-543d362ea9a0" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-70d13391-4ada-4fe5-b3ab-693cf61f398d" acquired by "delete_volume" :: waited 0.048s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:46 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3361ce2-489a-4f8f-8239-92ed39e3cbf0]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Deleted volume successfully. Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39438a7-c3e7-4d42-8c18-311c12d69c6d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc54182e-1de4-499c-b9a8-d4bc81a4a76f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-e8f4b1ea-36fa-400a-bc66-3539fa090f75-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:46 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 Sep 30 22:34:46 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:46 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d Sep 30 22:34:46 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:46 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0" returned: 0 in 0.482s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:46 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0 Sep 30 22:34:46 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:46 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d" returned: 0 in 0.586s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:46 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d Sep 30 22:34:46 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:46 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-43328400-9b01-4e46-92e6-543d362ea9a0" returned: 0 in 0.325s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "cinder-quobyte-43328400-9b01-4e46-92e6-543d362ea9a0" released by "delete_volume" :: held 0.893s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Created reservations ['7ac62ebd-2d30-4907-aa76-e32f62d38f3c', 'cf7b6b0f-25db-46ca-935d-b204640999e3', 'd86d6a78-2550-4346-afb6-c4ba2eb7e034', '449fac8e-2d15-4010-86f5-1d15c898f32b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:47 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-70d13391-4ada-4fe5-b3ab-693cf61f398d" returned: 0 in 0.376s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-70d13391-4ada-4fe5-b3ab-693cf61f398d" released by "delete_volume" :: held 1.069s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:47 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:47 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created reservations ['e61cbc6b-fb3e-4703-96fc-10a1e44d26df', 'a07e8a4d-23f3-4689-bcd8-1ac783b1cdb0', '638d5355-bf6a-401e-80e4-90e7d59cedc5', '754324b6-b9a4-4f9d-9a1b-234acaacec6f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:47 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:47 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:47 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.308s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Deleted volume successfully. Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-264ab19d-4e28-4ff6-8735-e0435f452190 tempest-VolumeAndVolumeTypeFromImageTest-1277190508 None] Lock "cinder-43328400-9b01-4e46-92e6-543d362ea9a0-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:47 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.290s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Deleted volume successfully. Sep 30 22:34:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bc7ebfc4-4af6-407a-b794-cc06618e4316 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-70d13391-4ada-4fe5-b3ab-693cf61f398d-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-ad296d68-d8e2-4261-9fe8-12db79b05816-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-ad296d68-d8e2-4261-9fe8-12db79b05816-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-quobyte-ad296d68-d8e2-4261-9fe8-12db79b05816" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-ad296d68-d8e2-4261-9fe8-12db79b05816" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a33a660-cbc9-4d63-b15e-f93975e564d0]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:48 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816 Sep 30 22:34:48 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Flow 'volume_create_manager' (a786e1e5-9406-44df-8567-e5db6c4fff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79c430e-7b3c-4d47-b49c-a4a311bf5e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79c430e-7b3c-4d47-b49c-a4a311bf5e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1114858728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc810a42-4a27-4ac6-9fb2-de529b081336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949f0430b1b24df9ad9336998df630ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:49Z,use_quota=True,user_id='5ad97aea88584ad18561d139fa21032d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa92f74-77aa-41c3-bdbd-b435a0513727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa92f74-77aa-41c3-bdbd-b435a0513727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0c6786-0786-42dc-9349-f341089d2491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0c6786-0786-42dc-9349-f341089d2491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc810a42-4a27-4ac6-9fb2-de529b081336', 'volume_name': 'volume-bc810a42-4a27-4ac6-9fb2-de529b081336', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b81ae2-aefd-4389-81d9-20f342d674a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b81ae2-aefd-4389-81d9-20f342d674a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e122e9-815d-440a-8453-d3c7ef5341f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Volume bc810a42-4a27-4ac6-9fb2-de529b081336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc810a42-4a27-4ac6-9fb2-de529b081336', 'volume_size': 1} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1114858728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc810a42-4a27-4ac6-9fb2-de529b081336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949f0430b1b24df9ad9336998df630ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:49Z,use_quota=True,user_id='5ad97aea88584ad18561d139fa21032d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Creating volume bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:48 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:48 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 1073741824 Sep 30 22:34:48 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:48 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816" returned: 0 in 0.449s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:48 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816 Sep 30 22:34:48 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:49 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-ad296d68-d8e2-4261-9fe8-12db79b05816" returned: 0 in 0.298s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-ad296d68-d8e2-4261-9fe8-12db79b05816" released by "delete_volume" :: held 0.814s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created reservations ['7a57e183-68d7-4726-bcbf-efbe18711783', '98373079-bebb-4d4b-9279-9fa1da7cc8f9', '2a757a7b-7311-48cf-9ad6-7d9ce5eb0be0', '86585e94-22f3-4bc1-8aad-18bd1ccd3668'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:49 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 1073741824" returned: 0 in 0.521s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:49 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:49 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:49 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:49 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-5f446f94-f446-4196-bbd8-e62641217dad-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-5f446f94-f446-4196-bbd8-e62641217dad-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:49 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336" returned: 0 in 0.317s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e122e9-815d-440a-8453-d3c7ef5341f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc810a42-4a27-4ac6-9fb2-de529b081336', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bf45af-a457-427b-83f8-395e3a0c34a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-quobyte-5f446f94-f446-4196-bbd8-e62641217dad" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Volume volume-bc810a42-4a27-4ac6-9fb2-de529b081336 (bc810a42-4a27-4ac6-9fb2-de529b081336): created successfully Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bf45af-a457-427b-83f8-395e3a0c34a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Flow 'volume_create_manager' (a786e1e5-9406-44df-8567-e5db6c4fff1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-5f446f94-f446-4196-bbd8-e62641217dad" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-91a2c1ac-ac3a-403f-92d0-28e73407fbcf tempest-VolumeDependencyTests-1704939048 None] Created volume successfully. Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0a5092-1325-451e-85a4-58062edffde7]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:49 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.449s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Deleted volume successfully. Sep 30 22:34:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12a0a350-b391-46f0-be1e-edd6e0013e6f tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-ad296d68-d8e2-4261-9fe8-12db79b05816-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:49 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad Sep 30 22:34:49 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:50 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad" returned: 0 in 0.407s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:50 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad Sep 30 22:34:50 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:50 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5f446f94-f446-4196-bbd8-e62641217dad" returned: 0 in 0.289s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-5f446f94-f446-4196-bbd8-e62641217dad" released by "delete_volume" :: held 0.754s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created reservations ['f6be63bb-879b-4d44-80f6-ee533a0e05e5', '1aa81f22-e8a8-4c37-9fcf-ac5368a3d454', '05d185bd-d5be-4e7f-bcb6-389d37e2244a', 'db9027d0-6b6c-4291-a81e-08f278403f26'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:50 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:50 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:50 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.359s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:50 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Deleted volume successfully. Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-31d843fa-ce0e-49cc-8b81-ae07be986ccd tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-5f446f94-f446-4196-bbd8-e62641217dad-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-c7bd1830-6d04-4130-bee8-76ef9151226d-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-c7bd1830-6d04-4130-bee8-76ef9151226d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-quobyte-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-quobyte-c7bd1830-6d04-4130-bee8-76ef9151226d" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-c7bd1830-6d04-4130-bee8-76ef9151226d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Deleting offline snapshot c7bd1830-6d04-4130-bee8-76ef9151226d of volume 54f9de2e-b22f-4028-b7ee-14bd2d47dacf {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] snapshot_file for this snap is: volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Creating offline snapshot 16e02fc3-8a0a-41b1-9b54-3baf95aa800e of volume bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da7ee5d-af6e-43af-9da8-06950a150219]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f31c44-a907-4ccd-9d66-b125df3ce0f0]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:51 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 Sep 30 22:34:51 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:51 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d Sep 30 22:34:51 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:51 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336" returned: 0 in 0.409s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:51 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e 1G Sep 30 22:34:51 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:51 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d" returned: 0 in 0.503s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8830daa-8d6b-4185-9197-ce367193460d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:51 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf Sep 30 22:34:51 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:52 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e 1G" returned: 0 in 0.539s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc810a42-4a27-4ac6-9fb2-de529b081336 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:52 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc810a42-4a27-4ac6-9fb2-de529b081336 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e Sep 30 22:34:52 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:52 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" returned: 0 in 0.501s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:52 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d Sep 30 22:34:52 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:52 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc810a42-4a27-4ac6-9fb2-de529b081336 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e" returned: 0 in 0.396s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:52 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e is being set with open permissions: ugo+rw Sep 30 22:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:52 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e Sep 30 22:34:52 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:52 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d" returned: 0 in 0.477s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:52 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d Sep 30 22:34:52 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:52 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:53 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.info Sep 30 22:34:53 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:53 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf.c7bd1830-6d04-4130-bee8-76ef9151226d" returned: 0 in 0.311s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-c7bd1830-6d04-4130-bee8-76ef9151226d" released by "_delete_snapshot" :: held 1.965s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" released by "delete_snapshot" :: held 2.003s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created reservations ['4ba7a54a-2b47-4223-b431-cf104300b8d6', 'f593aeed-a2cd-4bac-8773-175351fc8742', 'ba86724e-92b3-4beb-a522-575bf6a6c1ab', 'e1dd5351-7e71-47d2-966c-f706203ccc8b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:53 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.info" returned: 0 in 0.339s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:53 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.info is being set with open permissions: ugo+rw Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Delete snapshot completed successfully. Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2345b017-020b-45be-93d9-300966e61afa tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-c7bd1830-6d04-4130-bee8-76ef9151226d-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:53 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.info Sep 30 22:34:53 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:53 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.info" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-df41300e-464c-4fe6-b548-7ab4cc53c92a tempest-VolumeDependencyTests-1704939048 None] Create snapshot completed successfully Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (633021ff-c909-446e-883e-4cffb4bcdccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269443da-82eb-4eb5-b378-0f31cdad6f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269443da-82eb-4eb5-b378-0f31cdad6f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1192417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c662993-96f3-4c76-902e-bddba9ea26b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:55Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04098a32-4882-4c45-983e-b64591d86158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04098a32-4882-4c45-983e-b64591d86158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930ba60c-981f-4de5-915f-1ff20d481697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930ba60c-981f-4de5-915f-1ff20d481697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c662993-96f3-4c76-902e-bddba9ea26b1', 'volume_name': 'volume-5c662993-96f3-4c76-902e-bddba9ea26b1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f3acba-fee1-400c-a2b0-7a5a08b915b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f3acba-fee1-400c-a2b0-7a5a08b915b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf2a66b-8716-4f29-adea-e05d876240d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Volume 5c662993-96f3-4c76-902e-bddba9ea26b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c662993-96f3-4c76-902e-bddba9ea26b1', 'volume_size': 1} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1192417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c662993-96f3-4c76-902e-bddba9ea26b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:55Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Creating volume 5c662993-96f3-4c76-902e-bddba9ea26b1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:54 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:54 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1 1073741824 Sep 30 22:34:54 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-54f9de2e-b22f-4028-b7ee-14bd2d47dacf-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-54f9de2e-b22f-4028-b7ee-14bd2d47dacf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "cinder-quobyte-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f5325a-e7cc-4261-a319-7adcefbde1da]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Flow 'volume_create_manager' (78530d04-e49c-4574-85bd-c70cacf4dc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff57137-79fb-495e-aebe-573fe43d9db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff57137-79fb-495e-aebe-573fe43d9db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-803781481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb7cbde-db0f-4388-bb20-e7b36727ccb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949f0430b1b24df9ad9336998df630ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16e02fc3-8a0a-41b1-9b54-3baf95aa800e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:55Z,use_quota=True,user_id='5ad97aea88584ad18561d139fa21032d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc81a173-d70a-4f75-bd6d-99f3e90cb795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc81a173-d70a-4f75-bd6d-99f3e90cb795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a160fdf-5158-47e8-91cb-3961792504b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf Sep 30 22:34:55 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a160fdf-5158-47e8-91cb-3961792504b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dfb7cbde-db0f-4388-bb20-e7b36727ccb7', 'volume_name': 'volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7', 'volume_size': 1, 'snapshot_id': '16e02fc3-8a0a-41b1-9b54-3baf95aa800e'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd9fbbe-1131-4bbd-9c2b-9499297794e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd9fbbe-1131-4bbd-9c2b-9499297794e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38327eb8-d7d0-4065-a2aa-8c613a3a4758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Volume dfb7cbde-db0f-4388-bb20-e7b36727ccb7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7', 'volume_size': 1, 'snapshot_id': '16e02fc3-8a0a-41b1-9b54-3baf95aa800e'} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (59a28686-629b-43f0-88ea-c6a51165aec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f159c997-29fa-4074-a2b5-1c6d2495df7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f159c997-29fa-4074-a2b5-1c6d2495df7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-686819322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bffe681-1f85-4dc4-bfac-1e522ea48c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:55Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b66bcd-a0b2-478a-961d-78a5ed1985ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b66bcd-a0b2-478a-961d-78a5ed1985ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8e8d6b-ff97-49f9-9c6c-41d5bce28c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8e8d6b-ff97-49f9-9c6c-41d5bce28c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bffe681-1f85-4dc4-bfac-1e522ea48c32', 'volume_name': 'volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b086d5-6006-40e9-a520-0b91b086bb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b086d5-6006-40e9-a520-0b91b086bb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28beaa6e-daef-4169-a5d2-e0b5b8df385f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Volume 9bffe681-1f85-4dc4-bfac-1e522ea48c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32', 'volume_size': 1} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1 1073741824" returned: 0 in 0.715s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:55 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1 Sep 30 22:34:55 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:55 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" returned: 0 in 0.592s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:55 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf Sep 30 22:34:55 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:55 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1" returned: 0 in 0.330s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.488s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "cinder-quobyte-16e02fc3-8a0a-41b1-9b54-3baf95aa800e-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf2a66b-8716-4f29-adea-e05d876240d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c662993-96f3-4c76-902e-bddba9ea26b1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33cd81a-ee50-4b58-a420-2877b228f004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (83d244b9-3a50-4c6d-8f67-5a9512773b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe5774f-1741-48ed-b6fa-9dc7231e269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-16e02fc3-8a0a-41b1-9b54-3baf95aa800e-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" acquired by "_create_volume_from_snapshot" :: waited 0.072s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Creating volume dfb7cbde-db0f-4388-bb20-e7b36727ccb7 from snapshot 16e02fc3-8a0a-41b1-9b54-3baf95aa800e {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "cinder-quobyte-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:34:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Volume volume-5c662993-96f3-4c76-902e-bddba9ea26b1 (5c662993-96f3-4c76-902e-bddba9ea26b1): created successfully Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33cd81a-ee50-4b58-a420-2877b228f004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (633021ff-c909-446e-883e-4cffb4bcdccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] snapshot: 16e02fc3-8a0a-41b1-9b54-3baf95aa800e, volume: dfb7cbde-db0f-4388-bb20-e7b36727ccb7, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe5774f-1741-48ed-b6fa-9dc7231e269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827054521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44591023-ec26-44e1-a75f-afc71b69daea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:56Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8267cd7-0446-4387-88ed-cbbd1fbd1745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8267cd7-0446-4387-88ed-cbbd1fbd1745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a86c3fd-ab00-48ac-8db4-96668156c5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a86c3fd-ab00-48ac-8db4-96668156c5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44591023-ec26-44e1-a75f-afc71b69daea', 'volume_name': 'volume-44591023-ec26-44e1-a75f-afc71b69daea', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d8248f-a835-442c-a15e-385abd471796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d8248f-a835-442c-a15e-385abd471796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af9f5cc-0761-491c-8013-b6cd5dcc7712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Volume 44591023-ec26-44e1-a75f-afc71b69daea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44591023-ec26-44e1-a75f-afc71b69daea', 'volume_size': 1} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bc5c0c7b-b3ea-460e-902e-ff3c72b51b08 tempest-CreateVolumesFromImageTest-965554309 None] Created volume successfully. Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:56 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f34d9af-33ac-4b10-8ebc-3a2ca380bc4e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" returned: 0 in 0.394s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-quobyte-54f9de2e-b22f-4028-b7ee-14bd2d47dacf" released by "delete_volume" :: held 1.100s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Created reservations ['8d958803-edf4-4a59-952d-fd06d3416166', 'e25e54a2-6425-4c71-a92b-7fda204c48fa', '9fdb4e33-ad01-40ad-bfa4-2be1bf81441e', 'd2de8c6a-06af-42f8-9fbb-94c6c7574657'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:34:56 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e Sep 30 22:34:56 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:56 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:34:56 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (37d5c68f-c2f6-42de-80ba-bca68c8547b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b040ed-0f26-4170-8dd6-1a4bc65bb149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b040ed-0f26-4170-8dd6-1a4bc65bb149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225153297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462aea80-421e-4390-a09e-4ec0a9e8799a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:56Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbcc88a-9ddb-49a0-afb9-fccbd0a3d5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbcc88a-9ddb-49a0-afb9-fccbd0a3d5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9aa3d39-59e0-4465-90ae-e259deb5ab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9aa3d39-59e0-4465-90ae-e259deb5ab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462aea80-421e-4390-a09e-4ec0a9e8799a', 'volume_name': 'volume-462aea80-421e-4390-a09e-4ec0a9e8799a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1120ddd-992c-4150-b0ff-00a8461c4db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1120ddd-992c-4150-b0ff-00a8461c4db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d740a2cb-4770-4405-b89b-e501fe01d140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Volume 462aea80-421e-4390-a09e-4ec0a9e8799a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462aea80-421e-4390-a09e-4ec0a9e8799a', 'volume_size': 1} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:56 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e" returned: 0 in 0.635s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc810a42-4a27-4ac6-9fb2-de529b081336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:34:56 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.364s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b1bfe1-e3e5-46ca-901f-6f797ce1a3f2]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Deleted volume successfully. Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e5af8c87-6506-46c4-a214-f420a1d32310 tempest-CreateVolumesFromSnapshotTest-1595760193 None] Lock "cinder-54f9de2e-b22f-4028-b7ee-14bd2d47dacf-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:34:56 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 Sep 30 22:34:56 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (860cb22f-55bb-4b00-b1ca-4e4e0a035224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87469e-efc9-4b49-8a77-d37324f32d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87469e-efc9-4b49-8a77-d37324f32d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897442871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6116511-6eab-4e2a-9800-038f91cedcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:57Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5270bd5-49be-46ce-a7d7-ded699e3fc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5270bd5-49be-46ce-a7d7-ded699e3fc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938f2f2f-b25f-42de-9e87-18d2e184835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938f2f2f-b25f-42de-9e87-18d2e184835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6116511-6eab-4e2a-9800-038f91cedcc8', 'volume_name': 'volume-a6116511-6eab-4e2a-9800-038f91cedcc8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fcceaf-47d0-4407-bec5-7f4d1b4158fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fcceaf-47d0-4407-bec5-7f4d1b4158fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3da6224-c895-49bd-8cbe-8f69b18cf1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:34:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Volume a6116511-6eab-4e2a-9800-038f91cedcc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6116511-6eab-4e2a-9800-038f91cedcc8', 'volume_size': 1} Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:34:57 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336" returned: 0 in 0.431s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:34:57 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 Sep 30 22:34:57 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:02 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Flow 'volume_create_manager' (3f600fe2-77dd-4697-b4ce-903a838358c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39640744-ea98-4589-97bd-22fadad104c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39640744-ea98-4589-97bd-22fadad104c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93e6ca5-0f63-40ad-9378-3c17e4af9aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69529095e5a6463cb8418a26cfb54554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:03Z,use_quota=True,user_id='7c6679e6f5ed43b4bf47b4ee3a08a081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120956d7-c856-4d07-ac46-fa08e9a4fe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120956d7-c856-4d07-ac46-fa08e9a4fe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8e6cf9-23a5-443f-bea0-74ce8443a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8e6cf9-23a5-443f-bea0-74ce8443a764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93e6ca5-0f63-40ad-9378-3c17e4af9aa0', 'volume_name': 'volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44545e1e-a7a7-471b-bbb7-a53e018f8dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44545e1e-a7a7-471b-bbb7-a53e018f8dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e055fe79-8bfa-4abf-ba1b-f589ce1c4f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Volume e93e6ca5-0f63-40ad-9378-3c17e4af9aa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0', 'volume_size': 1} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:03 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:03 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:03 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.448s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:35:05 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" returned: 0 in 8.018s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:35:05 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Converted 1024.00 MB image at 127.69 MB/s Sep 30 22:35:05 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 is being set with open permissions: ugo+rw Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:05 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 Sep 30 22:35:05 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:05 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" released by "_copy_volume_from_snapshot" :: held 9.505s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-16e02fc3-8a0a-41b1-9b54-3baf95aa800e-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" released by "_create_volume_from_snapshot" :: held 9.586s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.660s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.042s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-686819322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bffe681-1f85-4dc4-bfac-1e522ea48c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:55Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Creating volume 9bffe681-1f85-4dc4-bfac-1e522ea48c32 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:05 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:05 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 1073741824 Sep 30 22:35:05 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38327eb8-d7d0-4065-a2aa-8c613a3a4758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7', 'volume_size': 1, 'snapshot_id': '16e02fc3-8a0a-41b1-9b54-3baf95aa800e'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94485e8-d74e-4cf9-a3e9-761a6253173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Volume volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 (dfb7cbde-db0f-4388-bb20-e7b36727ccb7): created successfully Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94485e8-d74e-4cf9-a3e9-761a6253173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Flow 'volume_create_manager' (78530d04-e49c-4574-85bd-c70cacf4dc4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-caf042fc-b1b2-4ddb-9ecd-1852e4a83c95 tempest-VolumeDependencyTests-1704939048 None] Created volume successfully. Sep 30 22:35:05 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 1073741824" returned: 0 in 0.432s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:06 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 Sep 30 22:35:06 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:06 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.219s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827054521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44591023-ec26-44e1-a75f-afc71b69daea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:56Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Creating volume 44591023-ec26-44e1-a75f-afc71b69daea {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:06 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28beaa6e-daef-4169-a5d2-e0b5b8df385f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:06 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea 1073741824 Sep 30 22:35:06 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb7cf72-99aa-43c1-b280-096c1175ffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Volume volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 (9bffe681-1f85-4dc4-bfac-1e522ea48c32): created successfully Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb7cf72-99aa-43c1-b280-096c1175ffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (59a28686-629b-43f0-88ea-c6a51165aec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e9cf15a6-6eb9-41d5-887f-a7dfd57de3f1 tempest-CreateVolumesFromImageTest-965554309 None] Created volume successfully. Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "cinder-16e02fc3-8a0a-41b1-9b54-3baf95aa800e-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-16e02fc3-8a0a-41b1-9b54-3baf95aa800e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "cinder-quobyte-bc810a42-4a27-4ac6-9fb2-de529b081336" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-bc810a42-4a27-4ac6-9fb2-de529b081336" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "cinder-quobyte-16e02fc3-8a0a-41b1-9b54-3baf95aa800e" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-16e02fc3-8a0a-41b1-9b54-3baf95aa800e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Deleting offline snapshot 16e02fc3-8a0a-41b1-9b54-3baf95aa800e of volume bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] snapshot_file for this snap is: volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:35:06 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabf5d9a-685e-40e1-b244-449a1e8191a4]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea 1073741824" returned: 0 in 0.511s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:06 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea Sep 30 22:35:06 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:06 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e Sep 30 22:35:06 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:07 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea" returned: 0 in 0.332s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.601s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-225153297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462aea80-421e-4390-a09e-4ec0a9e8799a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:56Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Creating volume 462aea80-421e-4390-a09e-4ec0a9e8799a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:07 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af9f5cc-0761-491c-8013-b6cd5dcc7712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44591023-ec26-44e1-a75f-afc71b69daea', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:07 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a 1073741824 Sep 30 22:35:07 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ade557-b61e-48a1-8ab9-5a9150a2d9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Volume volume-44591023-ec26-44e1-a75f-afc71b69daea (44591023-ec26-44e1-a75f-afc71b69daea): created successfully Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ade557-b61e-48a1-8ab9-5a9150a2d9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (83d244b9-3a50-4c6d-8f67-5a9512773b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:07 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e" returned: 0 in 0.474s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc810a42-4a27-4ac6-9fb2-de529b081336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:35:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b2b041b6-0a8d-4526-9f5f-db83e5d71969 tempest-CreateVolumesFromImageTest-965554309 None] Created volume successfully. Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7925bf-ee90-4733-9f0e-c61acf924bf7]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:07 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 Sep 30 22:35:07 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:07 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a 1073741824" returned: 0 in 0.443s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:07 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a Sep 30 22:35:07 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:07 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336" returned: 0 in 0.556s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:07 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e Sep 30 22:35:07 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:07 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a" returned: 0 in 0.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.914s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897442871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6116511-6eab-4e2a-9800-038f91cedcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6afefc1c4a4eec82035d5aa3b178ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:34:57Z,use_quota=True,user_id='3a1390efe3b34e4bb1d818f1bde68b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Creating volume a6116511-6eab-4e2a-9800-038f91cedcc8 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:07 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d740a2cb-4770-4405-b89b-e501fe01d140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462aea80-421e-4390-a09e-4ec0a9e8799a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a14d8dc-56e7-4e23-b01b-774aaf96258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:07 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8 1073741824 Sep 30 22:35:07 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Volume volume-462aea80-421e-4390-a09e-4ec0a9e8799a (462aea80-421e-4390-a09e-4ec0a9e8799a): created successfully Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a14d8dc-56e7-4e23-b01b-774aaf96258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (37d5c68f-c2f6-42de-80ba-bca68c8547b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-52e413df-a9ff-4256-91e7-aed229d928e4 tempest-CreateVolumesFromImageTest-965554309 None] Created volume successfully. Sep 30 22:35:08 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e" returned: 0 in 0.399s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:08 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e Sep 30 22:35:08 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:08 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8 1073741824" returned: 0 in 0.525s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:08 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336.16e02fc3-8a0a-41b1-9b54-3baf95aa800e" returned: 0 in 0.289s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:08 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8 Sep 30 22:35:08 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-16e02fc3-8a0a-41b1-9b54-3baf95aa800e" released by "_delete_snapshot" :: held 1.856s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-bc810a42-4a27-4ac6-9fb2-de529b081336" released by "delete_snapshot" :: held 1.882s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Created reservations ['5533c3b2-ec7b-4c35-bbb5-75771c88d6f3', 'cfe12725-3a6a-40d7-8b21-fec36857630e', '0c1e45f6-1134-4365-ba83-c44fbe468ec7', '4d0e1b15-cfd0-4cc2-82b1-345f39ba69d5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Delete snapshot completed successfully. Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36bcdaee-06b3-4352-a69d-8e47e95fcda7 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-16e02fc3-8a0a-41b1-9b54-3baf95aa800e-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:08 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8" returned: 0 in 0.265s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.731s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93e6ca5-0f63-40ad-9378-3c17e4af9aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69529095e5a6463cb8418a26cfb54554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:03Z,use_quota=True,user_id='7c6679e6f5ed43b4bf47b4ee3a08a081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Creating volume e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:08 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3da6224-c895-49bd-8cbe-8f69b18cf1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6116511-6eab-4e2a-9800-038f91cedcc8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9799ca4f-5ea9-45f2-b4e5-de66b3b639cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:08 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 1073741824 Sep 30 22:35:08 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Volume volume-a6116511-6eab-4e2a-9800-038f91cedcc8 (a6116511-6eab-4e2a-9800-038f91cedcc8): created successfully Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9799ca4f-5ea9-45f2-b4e5-de66b3b639cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Flow 'volume_create_manager' (860cb22f-55bb-4b00-b1ca-4e4e0a035224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "cinder-bc810a42-4a27-4ac6-9fb2-de529b081336-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f873c052-4f1d-4f62-aa89-65a88812e137 tempest-CreateVolumesFromImageTest-965554309 None] Created volume successfully. Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-bc810a42-4a27-4ac6-9fb2-de529b081336-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "cinder-quobyte-bc810a42-4a27-4ac6-9fb2-de529b081336" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-bc810a42-4a27-4ac6-9fb2-de529b081336" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e1d9d4-5893-4eb5-b33f-acfb05f9a626]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:09 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 Sep 30 22:35:09 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:09 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 1073741824" returned: 0 in 0.543s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:09 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-a6116511-6eab-4e2a-9800-038f91cedcc8-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:09 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-a6116511-6eab-4e2a-9800-038f91cedcc8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-quobyte-a6116511-6eab-4e2a-9800-038f91cedcc8" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:09 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-a6116511-6eab-4e2a-9800-038f91cedcc8" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336" returned: 0 in 0.542s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b50c01d-25ac-4d1e-a0be-c66d210adf4d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:09 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336 Sep 30 22:35:09 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:09 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8 Sep 30 22:35:09 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:09 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0" returned: 0 in 0.365s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e055fe79-8bfa-4abf-ba1b-f589ce1c4f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe47f2e-707b-4fd0-86da-5fefd3fae419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Volume volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 (e93e6ca5-0f63-40ad-9378-3c17e4af9aa0): created successfully Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe47f2e-707b-4fd0-86da-5fefd3fae419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Flow 'volume_create_manager' (3f600fe2-77dd-4697-b4ce-903a838358c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e06c1489-d150-4e1c-89b2-cd76076c829f tempest-CinderUnicodeTest-447518858 None] Created volume successfully. Sep 30 22:35:09 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-bc810a42-4a27-4ac6-9fb2-de529b081336" returned: 0 in 0.337s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-bc810a42-4a27-4ac6-9fb2-de529b081336" released by "delete_volume" :: held 0.958s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Created reservations ['a05ac04c-8bc3-4d53-a9a9-efb3782aeae8', '318b30fa-c2b4-4851-9219-d4622d7e49d6', '23d34574-2bbf-4746-b8b9-7ff3a91f22e3', 'f7324a94-2985-4c90-be4b-1a72e7d0608c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:10 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8" returned: 0 in 0.448s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:10 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8 Sep 30 22:35:10 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:10 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:10 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:10 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a6116511-6eab-4e2a-9800-038f91cedcc8" returned: 0 in 0.316s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-a6116511-6eab-4e2a-9800-038f91cedcc8" released by "delete_volume" :: held 0.833s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Created reservations ['f1833ab2-e8a5-418e-b65a-cd5a1bf33a6c', '6461f592-c665-47cd-a966-61c3483eaaa1', '9ed30cfb-48dc-421e-94ca-88841dcf2520', '10f9fd28-79a9-46bd-96f2-674686ffc9e7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:10 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.352s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Deleted volume successfully. Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1ff84a0-36b3-44df-b2ab-c2686a66bc16 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-bc810a42-4a27-4ac6-9fb2-de529b081336-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:10 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:10 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-462aea80-421e-4390-a09e-4ec0a9e8799a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-462aea80-421e-4390-a09e-4ec0a9e8799a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-quobyte-462aea80-421e-4390-a09e-4ec0a9e8799a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-462aea80-421e-4390-a09e-4ec0a9e8799a" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d86471-ab7f-4cce-a29f-fde62468d9a2]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:10 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.354s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Deleted volume successfully. Sep 30 22:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4c732d4c-eb26-4b95-9a23-0aeb3b50a304 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-a6116511-6eab-4e2a-9800-038f91cedcc8-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:10 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a Sep 30 22:35:10 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Flow 'volume_create_manager' (5c2dd641-ff1e-40d9-b39b-063e1850d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843750dc-a56f-43eb-a1e2-8b32b3cdf38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843750dc-a56f-43eb-a1e2-8b32b3cdf38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-916485623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd0d1dd-1020-426d-855c-6d71e8258eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69529095e5a6463cb8418a26cfb54554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:11Z,use_quota=True,user_id='7c6679e6f5ed43b4bf47b4ee3a08a081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4fab86-1584-4b3a-9b19-09e575e382c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4fab86-1584-4b3a-9b19-09e575e382c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f32836-6d07-44bc-8ff8-50f734dedc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f32836-6d07-44bc-8ff8-50f734dedc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd0d1dd-1020-426d-855c-6d71e8258eca', 'volume_name': 'volume-5bd0d1dd-1020-426d-855c-6d71e8258eca', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c011c1-9193-4608-b9fc-20af07756f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c011c1-9193-4608-b9fc-20af07756f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80903223-1bc8-479f-9f56-af8d43612a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Volume 5bd0d1dd-1020-426d-855c-6d71e8258eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd0d1dd-1020-426d-855c-6d71e8258eca', 'volume_size': 1} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-916485623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd0d1dd-1020-426d-855c-6d71e8258eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69529095e5a6463cb8418a26cfb54554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:11Z,use_quota=True,user_id='7c6679e6f5ed43b4bf47b4ee3a08a081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Creating volume 5bd0d1dd-1020-426d-855c-6d71e8258eca {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:11 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "cinder-dfb7cbde-db0f-4388-bb20-e7b36727ccb7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:11 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca 1073741824 Sep 30 22:35:11 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-dfb7cbde-db0f-4388-bb20-e7b36727ccb7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "cinder-quobyte-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ec0700-5c19-4834-bb16-826143a8f96c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:11 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a" returned: 0 in 0.498s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:11 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a Sep 30 22:35:11 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:11 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 Sep 30 22:35:11 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:11 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-462aea80-421e-4390-a09e-4ec0a9e8799a" returned: 0 in 0.326s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-462aea80-421e-4390-a09e-4ec0a9e8799a" released by "delete_volume" :: held 0.895s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:11 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca 1073741824" returned: 0 in 0.530s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:11 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" returned: 0 in 0.439s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:11 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca Sep 30 22:35:11 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:11 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7 Sep 30 22:35:11 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Created reservations ['d4084c51-e49d-4477-91cf-1b436b79b200', '64721daf-5709-49d5-9462-ccb2870bd3be', 'c03df466-dc53-4dcb-8aea-b9e9fc535a53', '07d856f0-94fc-4ac7-a1a9-8b2c4bc0d565'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:12 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:12 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:12 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" returned: 0 in 0.329s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:12 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-quobyte-dfb7cbde-db0f-4388-bb20-e7b36727ccb7" released by "delete_volume" :: held 0.826s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca" returned: 0 in 0.381s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80903223-1bc8-479f-9f56-af8d43612a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd0d1dd-1020-426d-855c-6d71e8258eca', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6944b54c-3859-4618-b5c9-cf24b29ee893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Volume volume-5bd0d1dd-1020-426d-855c-6d71e8258eca (5bd0d1dd-1020-426d-855c-6d71e8258eca): created successfully Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6944b54c-3859-4618-b5c9-cf24b29ee893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Flow 'volume_create_manager' (5c2dd641-ff1e-40d9-b39b-063e1850d352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-08f45f43-3772-4b87-8565-626bec6f676b tempest-CinderUnicodeTest-447518858 None] Created volume successfully. Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Created reservations ['3154f47f-95ed-470d-bb3f-2b5a66267671', '0a29861e-f6fc-46ba-b03c-6bef0cb2ca4a', 'e4c98984-5690-44a4-9da1-bea92f62408f', '13a83fb6-f6f8-477a-9aa2-8c6a171435ed'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:12 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.296s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Deleted volume successfully. Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-262cacd3-33c7-47b0-8c14-ed573678074f tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-462aea80-421e-4390-a09e-4ec0a9e8799a-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:12 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:12 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:12 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.272s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Deleted volume successfully. Sep 30 22:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34e351aa-aa6d-4845-9408-4ec5140c32b0 tempest-VolumeDependencyTests-1704939048 None] Lock "cinder-dfb7cbde-db0f-4388-bb20-e7b36727ccb7-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-44591023-ec26-44e1-a75f-afc71b69daea-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-44591023-ec26-44e1-a75f-afc71b69daea-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-quobyte-44591023-ec26-44e1-a75f-afc71b69daea" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-44591023-ec26-44e1-a75f-afc71b69daea" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8573fe-667d-4a97-86a5-41e0771462de]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:13 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea Sep 30 22:35:13 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Creating offline snapshot 7e9dd50e-cd99-4104-8dd7-92866ddd3e33 of volume 5bd0d1dd-1020-426d-855c-6d71e8258eca {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf8c5f-4691-43ec-a4e3-6234178dc10c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:13 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea" returned: 0 in 0.521s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:13 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca Sep 30 22:35:13 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:13 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea Sep 30 22:35:13 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:14 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-44591023-ec26-44e1-a75f-afc71b69daea" returned: 0 in 0.329s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-44591023-ec26-44e1-a75f-afc71b69daea" released by "delete_volume" :: held 0.925s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:14 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca" returned: 0 in 0.494s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:14 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 1G Sep 30 22:35:14 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Created reservations ['d6940517-182c-4ac7-9145-9ba788b22c7e', '4e1a8d91-39be-4e1e-b4ed-edbb84573bf5', '3fd6c806-1601-4b2a-b57f-16bf01529739', '102206cd-ffc0-4f2a-ac8c-313d6c9ae648'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:14 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:14 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:14 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.305s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:14 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Deleted volume successfully. Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 1G" returned: 0 in 0.536s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd0d1dd-1020-426d-855c-6d71e8258eca -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42aecec0-909b-4ba2-b705-d2b67aabfdda tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-44591023-ec26-44e1-a75f-afc71b69daea-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:14 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd0d1dd-1020-426d-855c-6d71e8258eca -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 Sep 30 22:35:14 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:14 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd0d1dd-1020-426d-855c-6d71e8258eca -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33" returned: 0 in 0.325s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:14 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 is being set with open permissions: ugo+rw Sep 30 22:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:14 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 Sep 30 22:35:14 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:15 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33" returned: 0 in 0.310s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:15 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.info Sep 30 22:35:15 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-9bffe681-1f85-4dc4-bfac-1e522ea48c32-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-9bffe681-1f85-4dc4-bfac-1e522ea48c32-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-quobyte-9bffe681-1f85-4dc4-bfac-1e522ea48c32" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-9bffe681-1f85-4dc4-bfac-1e522ea48c32" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[45af0255-7d85-4296-b195-d5df39db441d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:15 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.info" returned: 0 in 0.325s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:15 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.info is being set with open permissions: ugo+rw Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:15 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 Sep 30 22:35:15 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:15 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.info Sep 30 22:35:15 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:15 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.info" returned: 0 in 0.340s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.459s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:15 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32" returned: 0 in 0.523s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:16 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32 Sep 30 22:35:16 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-720627a6-68b9-430f-877a-8438da5d2579 tempest-CinderUnicodeTest-447518858 None] Create snapshot completed successfully Sep 30 22:35:16 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9bffe681-1f85-4dc4-bfac-1e522ea48c32" returned: 0 in 0.285s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-9bffe681-1f85-4dc4-bfac-1e522ea48c32" released by "delete_volume" :: held 0.868s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Created reservations ['c1ca957f-6ba4-41d8-8632-a1856cbaf78a', '9534d8aa-31d9-4b88-bb22-c7eb579ef127', '1058ba84-c828-47b7-9b12-6fea43d0e503', 'f81e619d-59ab-43f3-a48e-65ef31d8fe05'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:16 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:16 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-5c662993-96f3-4c76-902e-bddba9ea26b1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a1607f2d-965e-4e3d-abe2-18dd6f80956b tempest-ProjectAdminTests-1771667454 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.893783569336, 'free_capacity_gb': 1774.893783569336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87240) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-5c662993-96f3-4c76-902e-bddba9ea26b1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "cinder-quobyte-5c662993-96f3-4c76-902e-bddba9ea26b1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-5c662993-96f3-4c76-902e-bddba9ea26b1" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[74270d08-387a-4faf-8ac8-4418626ab609]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:16 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.390s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Deleted volume successfully. Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b5e196a4-6422-42e7-94a2-2fbfe77a5ae5 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-9bffe681-1f85-4dc4-bfac-1e522ea48c32-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Acquiring lock "cinder-7e9dd50e-cd99-4104-8dd7-92866ddd3e33-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-7e9dd50e-cd99-4104-8dd7-92866ddd3e33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Acquiring lock "cinder-quobyte-5bd0d1dd-1020-426d-855c-6d71e8258eca" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-quobyte-5bd0d1dd-1020-426d-855c-6d71e8258eca" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Acquiring lock "cinder-quobyte-7e9dd50e-cd99-4104-8dd7-92866ddd3e33" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-quobyte-7e9dd50e-cd99-4104-8dd7-92866ddd3e33" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Deleting offline snapshot 7e9dd50e-cd99-4104-8dd7-92866ddd3e33 of volume 5bd0d1dd-1020-426d-855c-6d71e8258eca {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:35:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] snapshot_file for this snap is: volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:35:16 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1 Sep 30 22:35:17 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb052f-2061-424a-80f8-31eb9823c505]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:17 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 Sep 30 22:35:17 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:17 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1" returned: 0 in 0.568s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:17 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1 Sep 30 22:35:17 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:17 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33" returned: 0 in 0.442s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bd0d1dd-1020-426d-855c-6d71e8258eca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd971310-55f6-4259-ab80-ff1d1d3d1d38]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:17 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c662993-96f3-4c76-902e-bddba9ea26b1" returned: 0 in 0.286s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-quobyte-5c662993-96f3-4c76-902e-bddba9ea26b1" released by "delete_volume" :: held 0.931s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:17 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca Sep 30 22:35:17 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Created reservations ['b577ad27-3db0-4964-98bd-76d0215a4eac', '9280f05c-baed-4807-a1dc-1928048293c1', '47afade2-b641-4978-9ac4-99fa3b7dc7b7', '83f6faa9-a800-4c95-9f88-5da697444875'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:17 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:17 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:18 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca" returned: 0 in 0.521s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:18 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 Sep 30 22:35:18 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:18 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.300s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Deleted volume successfully. Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2d9fa631-885e-4208-93e1-bee332290859 tempest-CreateVolumesFromImageTest-965554309 None] Lock "cinder-5c662993-96f3-4c76-902e-bddba9ea26b1-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:18 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33" returned: 0 in 0.405s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:18 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33 Sep 30 22:35:18 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:18 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca.7e9dd50e-cd99-4104-8dd7-92866ddd3e33" returned: 0 in 0.310s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-quobyte-7e9dd50e-cd99-4104-8dd7-92866ddd3e33" released by "_delete_snapshot" :: held 1.854s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-quobyte-5bd0d1dd-1020-426d-855c-6d71e8258eca" released by "delete_snapshot" :: held 1.882s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Created reservations ['7b2ca2ac-319e-4130-8d84-b18537b29807', '023177c8-c946-4272-95d1-96a2250fb924', '8f3c5812-029f-4dd5-9e45-d093b41c9db5', '6e656a3a-21cb-40c7-9c09-e36dee227817'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Delete snapshot completed successfully. Sep 30 22:35:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0c254ac8-49bc-4948-82f3-6296be9e5a40 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-7e9dd50e-cd99-4104-8dd7-92866ddd3e33-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Acquiring lock "cinder-5bd0d1dd-1020-426d-855c-6d71e8258eca-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-5bd0d1dd-1020-426d-855c-6d71e8258eca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Acquiring lock "cinder-quobyte-5bd0d1dd-1020-426d-855c-6d71e8258eca" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-quobyte-5bd0d1dd-1020-426d-855c-6d71e8258eca" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5763a0-c940-47ec-8753-8678370caee8]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:19 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca Sep 30 22:35:19 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:19 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca" returned: 0 in 0.529s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:19 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca Sep 30 22:35:19 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:20 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5bd0d1dd-1020-426d-855c-6d71e8258eca" returned: 0 in 0.344s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-quobyte-5bd0d1dd-1020-426d-855c-6d71e8258eca" released by "delete_volume" :: held 0.980s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Created reservations ['faf5b2af-55fe-4400-b9f5-1e9e39255b10', '6595520e-a069-4110-a35f-63360f7ffd18', '373d21f0-4c11-43d5-804a-c4e63b769ed6', '22eb2631-e742-49ed-b213-5a8f1e97b2cf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:20 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:20 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:20 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Deleted volume successfully. Sep 30 22:35:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7b18d059-10a7-41dd-b9d5-b69129e74da6 tempest-CinderUnicodeTest-447518858 None] Lock "cinder-5bd0d1dd-1020-426d-855c-6d71e8258eca-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Acquiring lock "cinder-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Lock "cinder-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Acquiring lock "cinder-quobyte-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Lock "cinder-quobyte-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[58084acd-2692-4956-8d30-694e39ff836d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:21 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 Sep 30 22:35:21 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:22 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0" returned: 0 in 0.548s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:22 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0 Sep 30 22:35:22 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:22 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0" returned: 0 in 0.315s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Lock "cinder-quobyte-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0" released by "delete_volume" :: held 0.929s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Created reservations ['a93941cf-5318-4ab6-a6b7-3db16cc6eff0', '6803e721-f55e-4228-889c-3a0142f0c125', '43968040-499b-43ca-8f3e-2c39532187e0', '8e4ac73b-e490-4057-8f34-939cd87d9738'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:22 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:22 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:23 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.363s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:23 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Deleted volume successfully. Sep 30 22:35:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c5cf5f7-4c7d-4a9d-ab01-da97c2ca233d tempest-CinderUnicodeTest-447518858 None] Lock "cinder-e93e6ca5-0f63-40ad-9378-3c17e4af9aa0-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=203,cinder:INSERT=80,cinder:UPDATE=288,cinder:DELETE=24 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=267,cinder:SELECT=200,cinder:DELETE=25,cinder:INSERT=69 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Flow 'volume_create_manager' (32afb0eb-720a-4c3b-8e8e-864d066ed8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600f83b4-f0a2-4ebc-843c-992444f36171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600f83b4-f0a2-4ebc-843c-992444f36171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052048866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fa423b-f0eb-4c87-99ec-785aefe16acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78e3939212e4c6298da51e806cbe52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:26Z,use_quota=True,user_id='73b997869ed54ef6bcf39500aab8b616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad5e921-9b73-4776-91e6-3f2fcb2c1f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad5e921-9b73-4776-91e6-3f2fcb2c1f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd153a12-5973-4699-b6cd-696a7a459985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd153a12-5973-4699-b6cd-696a7a459985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16fa423b-f0eb-4c87-99ec-785aefe16acc', 'volume_name': 'volume-16fa423b-f0eb-4c87-99ec-785aefe16acc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a655ce-9f39-451d-980d-ab550c77b257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a655ce-9f39-451d-980d-ab550c77b257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f28d22-6f41-4061-ac67-3dac6a1678c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Volume 16fa423b-f0eb-4c87-99ec-785aefe16acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16fa423b-f0eb-4c87-99ec-785aefe16acc', 'volume_size': 1} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052048866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fa423b-f0eb-4c87-99ec-785aefe16acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78e3939212e4c6298da51e806cbe52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:26Z,use_quota=True,user_id='73b997869ed54ef6bcf39500aab8b616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Creating volume 16fa423b-f0eb-4c87-99ec-785aefe16acc {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:25 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:26 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc 1073741824 Sep 30 22:35:26 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:26 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc 1073741824" returned: 0 in 0.606s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:26 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc Sep 30 22:35:26 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:26 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc" returned: 0 in 0.329s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f28d22-6f41-4061-ac67-3dac6a1678c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16fa423b-f0eb-4c87-99ec-785aefe16acc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d100cd-e8c8-4f0f-9161-105611949455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Volume volume-16fa423b-f0eb-4c87-99ec-785aefe16acc (16fa423b-f0eb-4c87-99ec-785aefe16acc): created successfully Sep 30 22:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d100cd-e8c8-4f0f-9161-105611949455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Flow 'volume_create_manager' (32afb0eb-720a-4c3b-8e8e-864d066ed8c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d8cb9155-8714-4db7-9fd2-0bee005ed497 tempest-ProjectReaderTests-2138068283 None] Created volume successfully. Sep 30 22:35:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "cinder-16fa423b-f0eb-4c87-99ec-785aefe16acc-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Lock "cinder-16fa423b-f0eb-4c87-99ec-785aefe16acc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "cinder-quobyte-16fa423b-f0eb-4c87-99ec-785aefe16acc" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Lock "cinder-quobyte-16fa423b-f0eb-4c87-99ec-785aefe16acc" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7b1fa-96a1-4297-939b-6111e0317e93]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:28 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc Sep 30 22:35:28 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:28 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (d5994c7b-6e7f-4cab-8f50-fd4e4fa57fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6249ee07-e256-4dbe-a851-5dcddda11306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc" returned: 0 in 0.579s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6249ee07-e256-4dbe-a851-5dcddda11306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056734424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69fa398-57f9-474f-8c8b-fb09fbd59cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:29Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff27d1e-fe8b-4813-93cd-ac994708a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff27d1e-fe8b-4813-93cd-ac994708a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349183d0-c56c-44ce-b6dc-4e5eff22613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349183d0-c56c-44ce-b6dc-4e5eff22613a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69fa398-57f9-474f-8c8b-fb09fbd59cbc', 'volume_name': 'volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:29 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc Sep 30 22:35:29 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10c239d-34f9-4ce6-9da5-0150d278ed98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10c239d-34f9-4ce6-9da5-0150d278ed98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457df65f-01e1-4db9-9a5c-392a0df45915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Volume f69fa398-57f9-474f-8c8b-fb09fbd59cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc', 'volume_size': 1} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056734424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69fa398-57f9-474f-8c8b-fb09fbd59cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:29Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Creating volume f69fa398-57f9-474f-8c8b-fb09fbd59cbc {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:29 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:29 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc 1073741824 Sep 30 22:35:29 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:29 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-16fa423b-f0eb-4c87-99ec-785aefe16acc" returned: 0 in 0.436s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Lock "cinder-quobyte-16fa423b-f0eb-4c87-99ec-785aefe16acc" released by "delete_volume" :: held 1.074s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Created reservations ['cad13bfa-f3ef-40c3-a291-60625cdba90d', '0d715b4b-7192-491c-adf1-8de45d3febd7', 'e531f2fa-d2f9-4f51-90ae-772e160a724d', '19501e1f-6986-494d-b1fd-406300305ed3'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:29 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc 1073741824" returned: 0 in 0.572s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:29 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:29 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:29 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc Sep 30 22:35:29 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:29 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.314s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:29 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Deleted volume successfully. Sep 30 22:35:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a3a51f5c-e187-47b6-a205-0d76253db381 tempest-ProjectReaderTests-2138068283 None] Lock "cinder-16fa423b-f0eb-4c87-99ec-785aefe16acc-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:30 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" returned: 0 in 0.374s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457df65f-01e1-4db9-9a5c-392a0df45915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd53222-4e74-4f1d-8ed2-c486e5822ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Volume volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc (f69fa398-57f9-474f-8c8b-fb09fbd59cbc): created successfully Sep 30 22:35:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd53222-4e74-4f1d-8ed2-c486e5822ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (d5994c7b-6e7f-4cab-8f50-fd4e4fa57fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-cb91b55b-1d84-4c46-af16-740c88c1d591 tempest-ProjectMemberTests-243188612 None] Created volume successfully. Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Flow 'volume_create_manager' (f887cebb-d8bc-4887-9c1c-aed5054cfe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d9e34-b421-4176-9645-c26b8f4c35d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08d9e34-b421-4176-9645-c26b8f4c35d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1521167185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba56344-33db-4b0c-b2cd-598f4ac5bb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78e3939212e4c6298da51e806cbe52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:31Z,use_quota=True,user_id='73b997869ed54ef6bcf39500aab8b616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1fd6d0-44bb-484c-ae82-822f531b5ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1fd6d0-44bb-484c-ae82-822f531b5ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71be036b-7bb3-4179-a822-fc96c230eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71be036b-7bb3-4179-a822-fc96c230eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba56344-33db-4b0c-b2cd-598f4ac5bb77', 'volume_name': 'volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862ac6ed-c7b9-4495-85d8-20b6d808dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862ac6ed-c7b9-4495-85d8-20b6d808dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fade13c-962e-44f5-b2cb-719d43b2de2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Volume 6ba56344-33db-4b0c-b2cd-598f4ac5bb77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77', 'volume_size': 1} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1521167185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba56344-33db-4b0c-b2cd-598f4ac5bb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78e3939212e4c6298da51e806cbe52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:31Z,use_quota=True,user_id='73b997869ed54ef6bcf39500aab8b616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Creating volume 6ba56344-33db-4b0c-b2cd-598f4ac5bb77 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:31 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:31 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 1073741824 Sep 30 22:35:31 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:31 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 1073741824" returned: 0 in 0.525s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:31 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 Sep 30 22:35:31 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:32 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.526s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Creating offline snapshot 8eb9de9a-21fd-479d-9fc4-70a22b66a30e of volume f69fa398-57f9-474f-8c8b-fb09fbd59cbc {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fade13c-962e-44f5-b2cb-719d43b2de2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fb26d9-f5b7-4ea3-8b35-c1678fa780ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4cd8ab-bd10-4071-acbc-af22e9debc03]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Volume volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 (6ba56344-33db-4b0c-b2cd-598f4ac5bb77): created successfully Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fb26d9-f5b7-4ea3-8b35-c1678fa780ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Flow 'volume_create_manager' (f887cebb-d8bc-4887-9c1c-aed5054cfe05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f71590e8-b1a0-4a89-9b2f-cba3dfa4e753 tempest-ProjectReaderTests-2138068283 None] Created volume successfully. Sep 30 22:35:32 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc Sep 30 22:35:32 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:32 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" returned: 0 in 0.378s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:32 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e 1G Sep 30 22:35:32 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:33 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e 1G" returned: 0 in 0.511s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:33 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e Sep 30 22:35:33 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Acquiring lock "cinder-6ba56344-33db-4b0c-b2cd-598f4ac5bb77-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Lock "cinder-6ba56344-33db-4b0c-b2cd-598f4ac5bb77-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:33 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e" returned: 0 in 0.365s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:33 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e is being set with open permissions: ugo+rw Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Acquiring lock "cinder-quobyte-6ba56344-33db-4b0c-b2cd-598f4ac5bb77" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:33 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e Sep 30 22:35:33 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Lock "cinder-quobyte-6ba56344-33db-4b0c-b2cd-598f4ac5bb77" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d859d0c-e5ee-45dd-91ce-32cae0c3041b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:33 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 Sep 30 22:35:33 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:33 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e" returned: 0 in 0.295s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:33 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.info Sep 30 22:35:33 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:33 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77" returned: 0 in 0.492s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:34 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77 Sep 30 22:35:34 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:34 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.info" returned: 0 in 0.284s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:34 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.info is being set with open permissions: ugo+rw Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:34 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.info Sep 30 22:35:34 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:34 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-6ba56344-33db-4b0c-b2cd-598f4ac5bb77" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Lock "cinder-quobyte-6ba56344-33db-4b0c-b2cd-598f4ac5bb77" released by "delete_volume" :: held 0.836s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:34 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.info" returned: 0 in 0.294s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a0bd657c-7292-4c1f-a1d1-85511731f607 tempest-ProjectMemberTests-243188612 None] Create snapshot completed successfully Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Created reservations ['b1a15d47-08a2-43c4-924f-884cd8e741e1', '397675d6-579f-4ea9-bb5c-2d2e856806b2', 'd45a9eda-c7ac-4426-9e63-712af7cd6f23', 'beef2ba2-2438-4575-aeae-40caf70f69cf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:34 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:34 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-8eb9de9a-21fd-479d-9fc4-70a22b66a30e-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Lock "cinder-8eb9de9a-21fd-479d-9fc4-70a22b66a30e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-8eb9de9a-21fd-479d-9fc4-70a22b66a30e" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:34 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.428s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-8eb9de9a-21fd-479d-9fc4-70a22b66a30e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Deleting offline snapshot 8eb9de9a-21fd-479d-9fc4-70a22b66a30e of volume f69fa398-57f9-474f-8c8b-fb09fbd59cbc {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] snapshot_file for this snap is: volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:35:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Deleted volume successfully. Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a41f8-930f-48d6-8764-f01fe959e573]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cf7f2462-cf36-4f20-bfed-f8c4b7ec444c tempest-ProjectReaderTests-2138068283 None] Lock "cinder-6ba56344-33db-4b0c-b2cd-598f4ac5bb77-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:35 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e Sep 30 22:35:35 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Flow 'volume_create_manager' (5427af6d-c2ab-4708-b86a-7a320c7d457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6a3b00-9b6a-42e4-9bf4-2f4fb396ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6a3b00-9b6a-42e4-9bf4-2f4fb396ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1377548056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20648f60-a24b-40ec-b0c3-b89c92383aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78e3939212e4c6298da51e806cbe52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:35Z,use_quota=True,user_id='73b997869ed54ef6bcf39500aab8b616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b979a4ca-7a59-462f-8e5d-9c8df82ca7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b979a4ca-7a59-462f-8e5d-9c8df82ca7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463bdb8-97f4-4bf8-a2db-d6332ed9bb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463bdb8-97f4-4bf8-a2db-d6332ed9bb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20648f60-a24b-40ec-b0c3-b89c92383aaf', 'volume_name': 'volume-20648f60-a24b-40ec-b0c3-b89c92383aaf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfd182f-b42c-4c59-bca2-c7cd5c2c4d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfd182f-b42c-4c59-bca2-c7cd5c2c4d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbf2cb8-cb02-475e-a51e-92da672c1580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Volume 20648f60-a24b-40ec-b0c3-b89c92383aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20648f60-a24b-40ec-b0c3-b89c92383aaf', 'volume_size': 1} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1377548056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20648f60-a24b-40ec-b0c3-b89c92383aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78e3939212e4c6298da51e806cbe52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:35Z,use_quota=True,user_id='73b997869ed54ef6bcf39500aab8b616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Creating volume 20648f60-a24b-40ec-b0c3-b89c92383aaf {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:35 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:35 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf 1073741824 Sep 30 22:35:35 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:35 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e" returned: 0 in 0.571s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1921dc8a-6209-4e37-8cff-db38b62d80be]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:35 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc Sep 30 22:35:35 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:35 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf 1073741824" returned: 0 in 0.545s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:36 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" returned: 0 in 0.435s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:36 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf Sep 30 22:35:36 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:36 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e Sep 30 22:35:36 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:36 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf" returned: 0 in 0.290s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbf2cb8-cb02-475e-a51e-92da672c1580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20648f60-a24b-40ec-b0c3-b89c92383aaf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acd1592-fb4a-43e1-adb8-8dda4a71f548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Volume volume-20648f60-a24b-40ec-b0c3-b89c92383aaf (20648f60-a24b-40ec-b0c3-b89c92383aaf): created successfully Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acd1592-fb4a-43e1-adb8-8dda4a71f548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Flow 'volume_create_manager' (5427af6d-c2ab-4708-b86a-7a320c7d457e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c9091537-e3f3-4165-88c3-30d16c37fd93 tempest-ProjectReaderTests-2138068283 None] Created volume successfully. Sep 30 22:35:36 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e" returned: 0 in 0.407s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:36 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e Sep 30 22:35:36 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:36 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc.8eb9de9a-21fd-479d-9fc4-70a22b66a30e" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-8eb9de9a-21fd-479d-9fc4-70a22b66a30e" released by "_delete_snapshot" :: held 1.830s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" released by "delete_snapshot" :: held 1.865s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Created reservations ['8cfcaaa8-6dd5-4bb5-9a03-ad7e4097ac56', '81550904-b4e3-46fd-a079-80aedd92f7b1', 'cfd3309a-f5d8-4c45-b1b6-dc21a6749a20', 'beeb07b0-5152-465b-8ec7-6ce58010e700'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Delete snapshot completed successfully. Sep 30 22:35:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32ad597-626d-461a-bcb3-6226c55a9f9b tempest-ProjectMemberTests-243188612 None] Lock "cinder-8eb9de9a-21fd-479d-9fc4-70a22b66a30e-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-f69fa398-57f9-474f-8c8b-fb09fbd59cbc-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Lock "cinder-f69fa398-57f9-474f-8c8b-fb09fbd59cbc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72161f1-e314-4a55-8721-0eddcea5df6a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:37 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc Sep 30 22:35:37 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "cinder-20648f60-a24b-40ec-b0c3-b89c92383aaf-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Lock "cinder-20648f60-a24b-40ec-b0c3-b89c92383aaf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "cinder-quobyte-20648f60-a24b-40ec-b0c3-b89c92383aaf" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Lock "cinder-quobyte-20648f60-a24b-40ec-b0c3-b89c92383aaf" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:37 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" returned: 0 in 0.435s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e051d3-ba87-4f89-9ef2-c0234ff1a4ab]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:37 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc Sep 30 22:35:37 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:37 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf Sep 30 22:35:37 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:37 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" returned: 0 in 0.285s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-f69fa398-57f9-474f-8c8b-fb09fbd59cbc" released by "delete_volume" :: held 0.801s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Created reservations ['465a501b-89e3-4603-b63c-c876372b7bf8', '7b573e2a-890f-47f1-8518-a49234572179', '34cc3ae5-623f-45c2-a47d-e8bc5e5bb295', '6905f862-61e4-4aba-9fe8-819c014d9bc7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:38 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf" returned: 0 in 0.429s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:38 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf Sep 30 22:35:38 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:38 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:38 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:38 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-20648f60-a24b-40ec-b0c3-b89c92383aaf" returned: 0 in 0.304s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Lock "cinder-quobyte-20648f60-a24b-40ec-b0c3-b89c92383aaf" released by "delete_volume" :: held 0.797s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:38 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Deleted volume successfully. Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Created reservations ['abb070e7-c484-4cd5-96f4-6bb0d5311004', '8e2277c9-d809-41bc-892b-5763e026447b', '35c08450-ff31-406c-9703-6b6e81301802', 'f7e6f334-416f-46e8-aac1-2adb238a7a2f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-85f0bea7-39b7-49a0-a869-f78693ae1ea5 tempest-ProjectMemberTests-243188612 None] Lock "cinder-f69fa398-57f9-474f-8c8b-fb09fbd59cbc-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:38 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:38 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:38 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.297s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Deleted volume successfully. Sep 30 22:35:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (67ebaeab-325b-4b38-b7cf-19ee284a8c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf4be8e-57f9-4bd8-8c82-d5fd92365a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-78760510-69b5-4843-93ed-d17353b54bd3 tempest-ProjectReaderTests-2138068283 None] Lock "cinder-20648f60-a24b-40ec-b0c3-b89c92383aaf-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf4be8e-57f9-4bd8-8c82-d5fd92365a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1848522934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1608000-2f51-4f42-8798-3ab02601ef2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:39Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1e3768-dc95-490e-8fd4-c13a31aad27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1e3768-dc95-490e-8fd4-c13a31aad27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e831e4-6413-4050-8234-9444c5bcad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e831e4-6413-4050-8234-9444c5bcad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1608000-2f51-4f42-8798-3ab02601ef2e', 'volume_name': 'volume-d1608000-2f51-4f42-8798-3ab02601ef2e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec8b49e-2899-4d63-b257-75d11e032444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec8b49e-2899-4d63-b257-75d11e032444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb1af08-d6f3-48af-9e98-c89e4ea23441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Volume d1608000-2f51-4f42-8798-3ab02601ef2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1608000-2f51-4f42-8798-3ab02601ef2e', 'volume_size': 1} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1848522934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1608000-2f51-4f42-8798-3ab02601ef2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:39Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Creating volume d1608000-2f51-4f42-8798-3ab02601ef2e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:39 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:39 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e 1073741824 Sep 30 22:35:39 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Flow 'volume_create_manager' (a79a0288-030e-48f0-9e39-eb8f86f73fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc2b57b-f716-48f0-915c-f5f79ce60dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc2b57b-f716-48f0-915c-f5f79ce60dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222959371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0968440-6362-4996-b32d-1f7e6f038a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78e3939212e4c6298da51e806cbe52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:39Z,use_quota=True,user_id='73b997869ed54ef6bcf39500aab8b616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d27170c-05f7-404f-8b10-587f24265ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d27170c-05f7-404f-8b10-587f24265ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a006da7-d364-4c66-9bba-73132e6fd1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a006da7-d364-4c66-9bba-73132e6fd1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0968440-6362-4996-b32d-1f7e6f038a8f', 'volume_name': 'volume-a0968440-6362-4996-b32d-1f7e6f038a8f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78635ff1-7809-437d-98e7-c3662e64fac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78635ff1-7809-437d-98e7-c3662e64fac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675a36fc-5feb-4f87-a5d6-4736c0955254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Volume a0968440-6362-4996-b32d-1f7e6f038a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0968440-6362-4996-b32d-1f7e6f038a8f', 'volume_size': 1} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:39 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e 1073741824" returned: 0 in 0.488s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:39 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e Sep 30 22:35:39 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:39 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e" returned: 0 in 0.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1222959371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0968440-6362-4996-b32d-1f7e6f038a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78e3939212e4c6298da51e806cbe52e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:39Z,use_quota=True,user_id='73b997869ed54ef6bcf39500aab8b616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Creating volume a0968440-6362-4996-b32d-1f7e6f038a8f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:39 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb1af08-d6f3-48af-9e98-c89e4ea23441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1608000-2f51-4f42-8798-3ab02601ef2e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f 1073741824 Sep 30 22:35:39 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b241275-4931-4fbb-a6db-20f519882d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Volume volume-d1608000-2f51-4f42-8798-3ab02601ef2e (d1608000-2f51-4f42-8798-3ab02601ef2e): created successfully Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b241275-4931-4fbb-a6db-20f519882d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (67ebaeab-325b-4b38-b7cf-19ee284a8c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8eb8ac02-0105-4076-b79f-9ea8dde10885 tempest-ProjectMemberTests-243188612 None] Created volume successfully. Sep 30 22:35:40 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f 1073741824" returned: 0 in 0.483s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:40 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f Sep 30 22:35:40 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:40 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f" returned: 0 in 0.251s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675a36fc-5feb-4f87-a5d6-4736c0955254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0968440-6362-4996-b32d-1f7e6f038a8f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfc445a-9d38-4a84-ae9d-9a5bad324177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Volume volume-a0968440-6362-4996-b32d-1f7e6f038a8f (a0968440-6362-4996-b32d-1f7e6f038a8f): created successfully Sep 30 22:35:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfc445a-9d38-4a84-ae9d-9a5bad324177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Flow 'volume_create_manager' (a79a0288-030e-48f0-9e39-eb8f86f73fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ec2cd03a-745d-406d-9349-773764bfc490 tempest-ProjectReaderTests-2138068283 None] Created volume successfully. Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Creating offline snapshot f748a00d-0202-4da7-ad5b-993fff90921f of volume d1608000-2f51-4f42-8798-3ab02601ef2e {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf37099-eb06-453a-aa7f-903eecb32b64]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:41 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e Sep 30 22:35:41 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Acquiring lock "cinder-a0968440-6362-4996-b32d-1f7e6f038a8f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:41 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e" returned: 0 in 0.401s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Lock "cinder-a0968440-6362-4996-b32d-1f7e6f038a8f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:41 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f 1G Sep 30 22:35:41 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Acquiring lock "cinder-quobyte-a0968440-6362-4996-b32d-1f7e6f038a8f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Lock "cinder-quobyte-a0968440-6362-4996-b32d-1f7e6f038a8f" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9723ba2d-0c31-4382-9728-7ffc464ad3ae]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:41 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f Sep 30 22:35:41 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:42 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f 1G" returned: 0 in 0.512s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1608000-2f51-4f42-8798-3ab02601ef2e -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:42 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:42 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1608000-2f51-4f42-8798-3ab02601ef2e -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f Sep 30 22:35:42 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f" returned: 0 in 0.433s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:42 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f Sep 30 22:35:42 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:42 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-a0968440-6362-4996-b32d-1f7e6f038a8f" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:42 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1608000-2f51-4f42-8798-3ab02601ef2e -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f" returned: 0 in 0.327s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:42 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f is being set with open permissions: ugo+rw Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Lock "cinder-quobyte-a0968440-6362-4996-b32d-1f7e6f038a8f" released by "delete_volume" :: held 0.778s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:42 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f Sep 30 22:35:42 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Created reservations ['f61c2e34-a78f-40dd-81bc-e05c3c1de0d7', '5b9c0875-0f71-4dd2-a445-a52e5659494a', 'f182a6ea-25e2-48d6-97c1-b1d62f5fff3d', '28b71688-cb5d-432f-ba8b-be10c177689b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:42 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:42 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:42 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f" returned: 0 in 0.290s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:42 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.info Sep 30 22:35:42 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:42 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.280s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Deleted volume successfully. Sep 30 22:35:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d1ad4d5b-d3b3-42d7-9c19-a743a463a98a tempest-ProjectReaderTests-2138068283 None] Lock "cinder-a0968440-6362-4996-b32d-1f7e6f038a8f-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:43 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.info" returned: 0 in 0.341s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:43 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.info is being set with open permissions: ugo+rw Sep 30 22:35:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:43 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.info Sep 30 22:35:43 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:43 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.info" returned: 0 in 0.339s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8a44bd71-c936-4227-b710-0ebe2fe244ec tempest-ProjectMemberTests-243188612 None] Create snapshot completed successfully Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-f748a00d-0202-4da7-ad5b-993fff90921f-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Lock "cinder-f748a00d-0202-4da7-ad5b-993fff90921f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-d1608000-2f51-4f42-8798-3ab02601ef2e" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-d1608000-2f51-4f42-8798-3ab02601ef2e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-f748a00d-0202-4da7-ad5b-993fff90921f" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-f748a00d-0202-4da7-ad5b-993fff90921f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Deleting offline snapshot f748a00d-0202-4da7-ad5b-993fff90921f of volume d1608000-2f51-4f42-8798-3ab02601ef2e {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] snapshot_file for this snap is: volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aca59a-903c-4f76-bf2e-eb1b9a92a7b2]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:44 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f Sep 30 22:35:44 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:44 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f" returned: 0 in 0.555s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1608000-2f51-4f42-8798-3ab02601ef2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:35:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e7d888-ef9b-44d1-96ed-33c5ed82156c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:45 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e Sep 30 22:35:45 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:45 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e" returned: 0 in 0.429s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:45 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f Sep 30 22:35:45 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:45 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f" returned: 0 in 0.399s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:45 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f Sep 30 22:35:45 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:46 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e.f748a00d-0202-4da7-ad5b-993fff90921f" returned: 0 in 0.298s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-f748a00d-0202-4da7-ad5b-993fff90921f" released by "_delete_snapshot" :: held 1.853s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-d1608000-2f51-4f42-8798-3ab02601ef2e" released by "delete_snapshot" :: held 1.889s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Created reservations ['e590aea7-c1f8-46b5-8789-02b6bc0d760d', '12aef463-2c1f-4672-977f-fc79beee7da0', 'b382b8ab-ae58-416f-bd27-6c5398e72470', 'bf85f30c-e2f3-4b41-9f04-93622d26fd90'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Delete snapshot completed successfully. Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8ca1e887-5d5f-4015-af1f-01b800bff190 tempest-ProjectMemberTests-243188612 None] Lock "cinder-f748a00d-0202-4da7-ad5b-993fff90921f-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-d1608000-2f51-4f42-8798-3ab02601ef2e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Lock "cinder-d1608000-2f51-4f42-8798-3ab02601ef2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-d1608000-2f51-4f42-8798-3ab02601ef2e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-d1608000-2f51-4f42-8798-3ab02601ef2e" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f4bc76-d941-438c-b350-87b195ba47c7]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:46 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e Sep 30 22:35:46 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:47 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e" returned: 0 in 0.381s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:47 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e Sep 30 22:35:47 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:47 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-d1608000-2f51-4f42-8798-3ab02601ef2e" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-d1608000-2f51-4f42-8798-3ab02601ef2e" released by "delete_volume" :: held 0.704s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Created reservations ['4c3b9bb0-d9a0-4874-89cd-83930bc875cd', '56286697-05da-446e-90ef-c3abf92bc41b', 'f30b66a9-017c-4ec9-b789-843c09948862', 'e4e8c11d-e3ae-4722-8c61-832697761f59'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:47 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:47 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:47 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.266s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Deleted volume successfully. Sep 30 22:35:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a375cf01-f16a-4624-a5b0-b703cc110879 tempest-ProjectMemberTests-243188612 None] Lock "cinder-d1608000-2f51-4f42-8798-3ab02601ef2e-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (ee22992a-98c5-4c67-bea2-d6b7751b3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0251b27-6ae9-4f46-b63e-9878fc5e3c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0251b27-6ae9-4f46-b63e-9878fc5e3c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535150404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcd9e73-f19a-497e-b64c-9c137f9ef45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:48Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb1d394-7081-46e5-9f82-63bb30fac60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb1d394-7081-46e5-9f82-63bb30fac60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d447d330-63f9-46a5-9045-d4c2f003c8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d447d330-63f9-46a5-9045-d4c2f003c8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcd9e73-f19a-497e-b64c-9c137f9ef45d', 'volume_name': 'volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c3a2a6-546f-4ddb-b537-b6db70cda163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c3a2a6-546f-4ddb-b537-b6db70cda163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e01466a-9ed7-4bd0-83d9-8c84d8a507fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Volume 3fcd9e73-f19a-497e-b64c-9c137f9ef45d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d', 'volume_size': 1} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535150404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcd9e73-f19a-497e-b64c-9c137f9ef45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:48Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Creating volume 3fcd9e73-f19a-497e-b64c-9c137f9ef45d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:48 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:48 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d 1073741824 Sep 30 22:35:48 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:48 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d 1073741824" returned: 0 in 0.530s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:48 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d Sep 30 22:35:48 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:49 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e01466a-9ed7-4bd0-83d9-8c84d8a507fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab117431-eb8b-4370-9206-a063f586143f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Volume volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d (3fcd9e73-f19a-497e-b64c-9c137f9ef45d): created successfully Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab117431-eb8b-4370-9206-a063f586143f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (ee22992a-98c5-4c67-bea2-d6b7751b3759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6a714502-d541-478d-bd8e-db3e5f17a9d1 tempest-ProjectMemberTests-243188612 None] Created volume successfully. Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Flow 'volume_create_manager' (c61fcd4b-b2f2-4cb4-81ab-a6d81ca07957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9377b8-9e59-451d-b851-ab0a05de8d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9377b8-9e59-451d-b851-ab0a05de8d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-830990899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5193a6-98a0-45f3-b667-769b2ba493b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3730eab9668d4f789d438bdc4a25406c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:49Z,use_quota=True,user_id='e4889e279f124e46a553bd37637cc9f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c8a316-0402-45a2-b150-e626c8e668e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c8a316-0402-45a2-b150-e626c8e668e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88aae9fd-fea3-466e-993c-29125e04ed93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88aae9fd-fea3-466e-993c-29125e04ed93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5193a6-98a0-45f3-b667-769b2ba493b7', 'volume_name': 'volume-dc5193a6-98a0-45f3-b667-769b2ba493b7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3477e0-5ff3-49d5-b44f-e10d4328ef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3477e0-5ff3-49d5-b44f-e10d4328ef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcb4d8b-2bc8-4780-a620-eb2a955d8b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Volume dc5193a6-98a0-45f3-b667-769b2ba493b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5193a6-98a0-45f3-b667-769b2ba493b7', 'volume_size': 1} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-830990899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5193a6-98a0-45f3-b667-769b2ba493b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3730eab9668d4f789d438bdc4a25406c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:49Z,use_quota=True,user_id='e4889e279f124e46a553bd37637cc9f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Creating volume dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:49 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 1073741824 Sep 30 22:35:49 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:50 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 1073741824" returned: 0 in 0.420s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:50 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 Sep 30 22:35:50 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:50 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7" returned: 0 in 0.246s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcb4d8b-2bc8-4780-a620-eb2a955d8b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5193a6-98a0-45f3-b667-769b2ba493b7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fc7bc8-ded9-469d-a882-cd5b26e7865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Volume volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 (dc5193a6-98a0-45f3-b667-769b2ba493b7): created successfully Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7fc7bc8-ded9-469d-a882-cd5b26e7865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Flow 'volume_create_manager' (c61fcd4b-b2f2-4cb4-81ab-a6d81ca07957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e666f61c-311f-4ff9-b430-c05087316286 tempest-SnapshotDependencyTests-1100086796 None] Created volume successfully. Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Creating offline snapshot 7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 of volume 3fcd9e73-f19a-497e-b64c-9c137f9ef45d {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ac4159-209d-4bdc-8f21-78ffcb83ecbc]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:50 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d Sep 30 22:35:50 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:50 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" returned: 0 in 0.380s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:50 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 1G Sep 30 22:35:50 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:51 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 1G" returned: 0 in 0.384s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:51 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 Sep 30 22:35:51 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:51 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55" returned: 0 in 0.285s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:51 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 is being set with open permissions: ugo+rw Sep 30 22:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:51 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 Sep 30 22:35:51 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:51 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:51 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.info Sep 30 22:35:51 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:52 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.info" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:52 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.info is being set with open permissions: ugo+rw Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:52 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.info Sep 30 22:35:52 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:52 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.info" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.577s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Creating offline snapshot fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf of volume dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:35:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e2f9bad0-a906-4b5f-8a62-04051f0fc606 tempest-ProjectMemberTests-243188612 None] Create snapshot completed successfully Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b18516-1415-47bf-9484-ba28518eaae5]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:52 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 Sep 30 22:35:52 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-7fe696e1-a52a-41f0-9f9b-c652b4c0dc55-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Lock "cinder-7fe696e1-a52a-41f0-9f9b-c652b4c0dc55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-7fe696e1-a52a-41f0-9f9b-c652b4c0dc55" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-7fe696e1-a52a-41f0-9f9b-c652b4c0dc55" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Deleting offline snapshot 7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 of volume 3fcd9e73-f19a-497e-b64c-9c137f9ef45d {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] snapshot_file for this snap is: volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3b7e1a-0820-4d9e-9944-b9f22ec24be9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:52 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7" returned: 0 in 0.404s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:52 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf 1G Sep 30 22:35:52 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 Sep 30 22:35:52 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:52 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:53 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55" returned: 0 in 0.380s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[022cc850-ebe1-42fe-aed1-e1eb6dc29704]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:53 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf 1G" returned: 0 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:53 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d Sep 30 22:35:53 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:53 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf Sep 30 22:35:53 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:53 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" returned: 0 in 0.368s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:53 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf" returned: 0 in 0.292s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:53 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf is being set with open permissions: ugo+rw Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:53 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 Sep 30 22:35:53 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:53 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf Sep 30 22:35:53 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:53 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf" returned: 0 in 0.246s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:53 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.info Sep 30 22:35:53 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:53 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55" returned: 0 in 0.335s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:53 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55 Sep 30 22:35:53 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:54 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.info" returned: 0 in 0.253s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:54 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.info is being set with open permissions: ugo+rw Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:54 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d.7fe696e1-a52a-41f0-9f9b-c652b4c0dc55" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:54 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.info Sep 30 22:35:54 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-7fe696e1-a52a-41f0-9f9b-c652b4c0dc55" released by "_delete_snapshot" :: held 1.438s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" released by "delete_snapshot" :: held 1.462s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Created reservations ['e86d1bbf-fd75-4cee-92f6-cc7d5aab155b', '87baf0f7-2103-4307-a6e8-4e1f6e0ef84d', '5b7110d7-4e28-44b1-b016-abfb16617c5d', '967f2fca-0ee3-4d6e-b8cd-32dd4768f11a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Delete snapshot completed successfully. Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74d93754-56be-45e1-a9e5-20d9a81a340b tempest-ProjectMemberTests-243188612 None] Lock "cinder-7fe696e1-a52a-41f0-9f9b-c652b4c0dc55-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:54 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.info" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a6d9df00-0a2a-404f-9f8c-dea17114d315 tempest-SnapshotDependencyTests-1100086796 None] Create snapshot completed successfully Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-3fcd9e73-f19a-497e-b64c-9c137f9ef45d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Lock "cinder-3fcd9e73-f19a-497e-b64c-9c137f9ef45d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf29ed0-96e0-43cf-9e42-5021d8306ce2]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:54 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d Sep 30 22:35:55 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:55 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" returned: 0 in 0.372s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:55 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d Sep 30 22:35:55 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:55 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" returned: 0 in 0.270s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-3fcd9e73-f19a-497e-b64c-9c137f9ef45d" released by "delete_volume" :: held 0.708s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Flow 'volume_create_manager' (641cde75-b18b-4e7a-83bd-f3b1706ace31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3112e01-92dc-4fcd-b0fd-b869e0b992f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3112e01-92dc-4fcd-b0fd-b869e0b992f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce436af-0161-40c2-9cb9-c553756c0f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3730eab9668d4f789d438bdc4a25406c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:55Z,use_quota=True,user_id='e4889e279f124e46a553bd37637cc9f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbe7cec-0842-4b93-8d7a-b60ddc0590e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbe7cec-0842-4b93-8d7a-b60ddc0590e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c384400f-040b-4f83-928e-42ff34ad34a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c384400f-040b-4f83-928e-42ff34ad34a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8ce436af-0161-40c2-9cb9-c553756c0f09', 'volume_name': 'volume-8ce436af-0161-40c2-9cb9-c553756c0f09', 'volume_size': 1, 'snapshot_id': 'fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5f96ee-3d7c-461c-8a91-bc09019ccdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5f96ee-3d7c-461c-8a91-bc09019ccdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd81eac0-cbf6-4881-a23d-e8fce31b0518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Volume 8ce436af-0161-40c2-9cb9-c553756c0f09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8ce436af-0161-40c2-9cb9-c553756c0f09', 'volume_size': 1, 'snapshot_id': 'fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf'} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "cinder-quobyte-fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf-8ce436af-0161-40c2-9cb9-c553756c0f09" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf-8ce436af-0161-40c2-9cb9-c553756c0f09" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Creating volume 8ce436af-0161-40c2-9cb9-c553756c0f09 from snapshot fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "cinder-quobyte-8ce436af-0161-40c2-9cb9-c553756c0f09" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-8ce436af-0161-40c2-9cb9-c553756c0f09" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] snapshot: fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf, volume: 8ce436af-0161-40c2-9cb9-c553756c0f09, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Created reservations ['4b7c8653-3319-4d4d-8919-869245f17739', '998c4497-36eb-43e6-b8e5-b76290a2758b', '6e7b8b1c-1275-4f53-83d6-a9cd39975541', 'f5091891-3f68-48f5-9dbb-0a54ff7e346e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5da7d00-86ce-4ac5-a800-74737a73da8f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:55 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:35:55 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:55 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf Sep 30 22:35:55 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:56 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.265s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:35:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Deleted volume successfully. Sep 30 22:35:56 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf" returned: 0 in 0.376s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5193a6-98a0-45f3-b667-769b2ba493b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6815e083-c06f-40f0-ae9a-31b83dda382e tempest-ProjectMemberTests-243188612 None] Lock "cinder-3fcd9e73-f19a-497e-b64c-9c137f9ef45d-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c40a95-2e32-4805-bdee-90875af4705f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:56 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 Sep 30 22:35:56 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (62187802-6d3a-43ff-825e-584dd2d7c9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9b7a54-368b-49a5-870a-196cc6ed55b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9b7a54-368b-49a5-870a-196cc6ed55b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173183572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e0f297-7302-44ad-81f1-b99c6bfad77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:56Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d1339d-0ae3-4efb-9787-b53101f804e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d1339d-0ae3-4efb-9787-b53101f804e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159749ee-8660-4c95-8a96-61f890e7d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159749ee-8660-4c95-8a96-61f890e7d371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e0f297-7302-44ad-81f1-b99c6bfad77b', 'volume_name': 'volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38a7162-9e94-495c-bb8b-0723db89fa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38a7162-9e94-495c-bb8b-0723db89fa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf13299-96a0-41ac-9c4b-e6e29a617106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:35:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Volume b1e0f297-7302-44ad-81f1-b99c6bfad77b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b', 'volume_size': 1} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:35:56 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7" returned: 0 in 0.382s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Path /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 30 22:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:35:56 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 Sep 30 22:35:56 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:02 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09" returned: 0 in 5.890s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Image conversion details: src /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 30 22:36:02 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Converted 1024.00 MB image at 173.82 MB/s Sep 30 22:36:02 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 is being set with open permissions: ugo+rw Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:02 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 Sep 30 22:36:02 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:02 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-8ce436af-0161-40c2-9cb9-c553756c0f09" released by "_copy_volume_from_snapshot" :: held 6.975s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf-8ce436af-0161-40c2-9cb9-c553756c0f09" released by "_create_volume_from_snapshot" :: held 7.037s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.057s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.208s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-173183572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e0f297-7302-44ad-81f1-b99c6bfad77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:35:56Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Creating volume b1e0f297-7302-44ad-81f1-b99c6bfad77b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:36:02 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:02 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b 1073741824 Sep 30 22:36:02 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd81eac0-cbf6-4881-a23d-e8fce31b0518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce436af-0161-40c2-9cb9-c553756c0f09', 'volume_size': 1, 'snapshot_id': 'fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eafe7a-e422-4ea7-b3fd-66fc89cd01e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:02 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Volume volume-8ce436af-0161-40c2-9cb9-c553756c0f09 (8ce436af-0161-40c2-9cb9-c553756c0f09): created successfully Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eafe7a-e422-4ea7-b3fd-66fc89cd01e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Flow 'volume_create_manager' (641cde75-b18b-4e7a-83bd-f3b1706ace31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3cd8a6bf-460c-4d28-b857-331387606412 tempest-SnapshotDependencyTests-1100086796 None] Created volume successfully. Sep 30 22:36:03 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b 1073741824" returned: 0 in 0.420s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:03 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:03 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:03 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b Sep 30 22:36:03 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "cinder-fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "cinder-quobyte-dc5193a6-98a0-45f3-b667-769b2ba493b7" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-dc5193a6-98a0-45f3-b667-769b2ba493b7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "cinder-quobyte-fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Deleting offline snapshot fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf of volume dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] snapshot_file for this snap is: volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf20933a-8a9d-447c-8090-edc79e659415]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:03 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.268s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:36:03 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf Sep 30 22:36:03 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:03 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf13299-96a0-41ac-9c4b-e6e29a617106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbc91e6-4d90-4a39-b342-75aea0e6528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Volume volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b (b1e0f297-7302-44ad-81f1-b99c6bfad77b): created successfully Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbc91e6-4d90-4a39-b342-75aea0e6528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (62187802-6d3a-43ff-825e-584dd2d7c9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b09fa2f6-fa06-4c8d-b6e0-b96be726ff20 tempest-ProjectMemberTests-243188612 None] Created volume successfully. Sep 30 22:36:03 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5193a6-98a0-45f3-b667-769b2ba493b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c37810-e892-4d0d-b8c2-7691f314a472]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:03 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 Sep 30 22:36:03 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Creating offline snapshot 211d5aed-8ac5-4f79-b51a-18a550299057 of volume b1e0f297-7302-44ad-81f1-b99c6bfad77b {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2339e81-b926-4946-9fd5-3a556ba39ff9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:04 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b Sep 30 22:36:04 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:04 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7" returned: 0 in 0.564s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:04 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf Sep 30 22:36:04 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:04 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b" returned: 0 in 0.370s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:04 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 1G Sep 30 22:36:04 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:04 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf" returned: 0 in 0.333s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:04 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf Sep 30 22:36:04 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:04 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:04 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 1G" returned: 0 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7.fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf" returned: 0 in 0.267s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:04 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 Sep 30 22:36:04 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf" released by "_delete_snapshot" :: held 1.639s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-dc5193a6-98a0-45f3-b667-769b2ba493b7" released by "delete_snapshot" :: held 1.670s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Created reservations ['27d70b7c-ac57-4648-ae77-423c5404cd56', '38629ffe-95d5-40a2-b6df-e27379ebcdd1', 'fd62fc39-20ac-4b75-9146-0babc420711e', 'c602971b-a1c1-475b-94b6-bd22210e05be'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Delete snapshot completed successfully. Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8065994b-606c-499f-b296-3f0737d29fe0 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-fdc7ecc0-5f7c-4153-85f7-8f0604e0dbdf-delete_snapshot" released by "delete_snapshot" :: held 1.805s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:05 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057" returned: 0 in 0.290s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:05 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 is being set with open permissions: ugo+rw Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:05 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 Sep 30 22:36:05 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:05 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "cinder-dc5193a6-98a0-45f3-b667-769b2ba493b7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057" returned: 0 in 0.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-dc5193a6-98a0-45f3-b667-769b2ba493b7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:05 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.info Sep 30 22:36:05 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "cinder-quobyte-dc5193a6-98a0-45f3-b667-769b2ba493b7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-dc5193a6-98a0-45f3-b667-769b2ba493b7" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e941a1-76dd-4f03-9242-b4629f9ab3f2]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:05 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 Sep 30 22:36:05 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:05 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.info" returned: 0 in 0.258s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:05 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.info is being set with open permissions: ugo+rw Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:05 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.info Sep 30 22:36:05 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:05 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:05 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7 Sep 30 22:36:05 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:05 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.info" returned: 0 in 0.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ae38a62f-c6fc-4a69-8e32-64a59c55b73c tempest-ProjectMemberTests-243188612 None] Create snapshot completed successfully Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-211d5aed-8ac5-4f79-b51a-18a550299057-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:06 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc5193a6-98a0-45f3-b667-769b2ba493b7" returned: 0 in 0.267s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Lock "cinder-211d5aed-8ac5-4f79-b51a-18a550299057-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-b1e0f297-7302-44ad-81f1-b99c6bfad77b" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-dc5193a6-98a0-45f3-b667-769b2ba493b7" released by "delete_volume" :: held 0.696s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-b1e0f297-7302-44ad-81f1-b99c6bfad77b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-211d5aed-8ac5-4f79-b51a-18a550299057" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-211d5aed-8ac5-4f79-b51a-18a550299057" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Deleting offline snapshot 211d5aed-8ac5-4f79-b51a-18a550299057 of volume b1e0f297-7302-44ad-81f1-b99c6bfad77b {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] snapshot_file for this snap is: volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1905f0-5045-457b-9e2e-ace665a846a1]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Created reservations ['4e2e030c-78f5-46f5-910c-c6e77264e8b8', 'de072cf9-ef4f-4c4b-977f-0d89eecf3d31', 'e24b0126-f65e-4eb3-a314-20dd43af05ab', '66ec871c-9df1-4f9d-87c7-d05f040de47a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:06 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:06 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:06 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 Sep 30 22:36:06 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "cinder-8ce436af-0161-40c2-9cb9-c553756c0f09-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:06 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-8ce436af-0161-40c2-9cb9-c553756c0f09-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.253s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Deleted volume successfully. Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ff054092-6dca-4e57-856e-2d9a4002784e tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-dc5193a6-98a0-45f3-b667-769b2ba493b7-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "cinder-quobyte-8ce436af-0161-40c2-9cb9-c553756c0f09" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-8ce436af-0161-40c2-9cb9-c553756c0f09" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:06 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057" returned: 0 in 0.415s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[268377db-0370-42c3-882a-cd4cef14021a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed2a93c-34aa-4e61-ad38-53b3e45c86df]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:06 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 Sep 30 22:36:06 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:06 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b Sep 30 22:36:06 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:07 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09" returned: 0 in 0.365s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:07 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b" returned: 0 in 0.367s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:07 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09 Sep 30 22:36:07 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:07 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 Sep 30 22:36:07 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:07 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-8ce436af-0161-40c2-9cb9-c553756c0f09" returned: 0 in 0.260s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-quobyte-8ce436af-0161-40c2-9cb9-c553756c0f09" released by "delete_volume" :: held 0.683s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Created reservations ['261545fe-ef75-42f2-89f0-2a315b29a4f6', '66f50ba6-df5c-42ea-bd5f-11558bc8b2be', '83a43b55-0fd4-4008-8764-b8f407d12c2b', '2661018a-e2f1-4157-ad5d-9bc9b7634c60'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:07 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057" returned: 0 in 0.384s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:07 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:07 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:07 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057 Sep 30 22:36:07 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:07 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Deleted volume successfully. Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ca79ed08-1bde-49bf-b96d-46c5f587fcf7 tempest-SnapshotDependencyTests-1100086796 None] Lock "cinder-8ce436af-0161-40c2-9cb9-c553756c0f09-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:07 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b.211d5aed-8ac5-4f79-b51a-18a550299057" returned: 0 in 0.295s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-211d5aed-8ac5-4f79-b51a-18a550299057" released by "_delete_snapshot" :: held 1.578s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-b1e0f297-7302-44ad-81f1-b99c6bfad77b" released by "delete_snapshot" :: held 1.614s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Created reservations ['6eb20740-e123-4a26-b798-4347fae655eb', 'dd8e8188-e27d-478f-a8f5-095c28146f32', 'e1b431eb-2bd6-4813-bd93-829a4241e7e8', '2b561ff1-f57e-4786-bfe2-08fd5c47e618'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Delete snapshot completed successfully. Sep 30 22:36:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-460c17aa-3a9f-4990-b988-4f9c20b53c22 tempest-ProjectMemberTests-243188612 None] Lock "cinder-211d5aed-8ac5-4f79-b51a-18a550299057-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-b1e0f297-7302-44ad-81f1-b99c6bfad77b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Lock "cinder-b1e0f297-7302-44ad-81f1-b99c6bfad77b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-b1e0f297-7302-44ad-81f1-b99c6bfad77b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-b1e0f297-7302-44ad-81f1-b99c6bfad77b" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b2125c-9fb7-44c0-8ab7-5e3ff491e56c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:08 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b Sep 30 22:36:08 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:08 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b" returned: 0 in 0.396s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:08 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b Sep 30 22:36:08 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:09 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-b1e0f297-7302-44ad-81f1-b99c6bfad77b" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-b1e0f297-7302-44ad-81f1-b99c6bfad77b" released by "delete_volume" :: held 0.720s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Created reservations ['9bca1df8-8def-4b41-afef-fc8c46456cde', '126a5724-b066-4af3-b2da-4a299b96cd75', '06a04640-6bcf-43c5-a07d-0c38566786a0', '3995b86e-288e-4f57-bd80-b94c2a76cdfb'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:09 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:09 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:09 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.275s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Deleted volume successfully. Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-306ddebf-66e3-406e-ae67-95276ab70f2e tempest-ProjectMemberTests-243188612 None] Lock "cinder-b1e0f297-7302-44ad-81f1-b99c6bfad77b-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (13c9ef2f-1c51-4ce7-9034-e98d46b9b117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccd9785-039a-44c0-a214-9bce15e0847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccd9785-039a-44c0-a214-9bce15e0847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182954185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bb2996-6868-4429-9c8b-803b37b849cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:10Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d4393c-eab9-4ab0-93d6-52974a4fdbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d4393c-eab9-4ab0-93d6-52974a4fdbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808e994e-dc91-4fc8-a650-5e1ec29ff15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808e994e-dc91-4fc8-a650-5e1ec29ff15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21bb2996-6868-4429-9c8b-803b37b849cc', 'volume_name': 'volume-21bb2996-6868-4429-9c8b-803b37b849cc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aeef26-07cd-4ba1-b8a7-3d7ac8e7714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aeef26-07cd-4ba1-b8a7-3d7ac8e7714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921c74fd-eb89-4108-9138-f10356956571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Volume 21bb2996-6868-4429-9c8b-803b37b849cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21bb2996-6868-4429-9c8b-803b37b849cc', 'volume_size': 1} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182954185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21bb2996-6868-4429-9c8b-803b37b849cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:10Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Creating volume 21bb2996-6868-4429-9c8b-803b37b849cc {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:36:10 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:10 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc 1073741824 Sep 30 22:36:10 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:10 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc 1073741824" returned: 0 in 0.428s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:10 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc Sep 30 22:36:10 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:10 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc" returned: 0 in 0.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921c74fd-eb89-4108-9138-f10356956571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21bb2996-6868-4429-9c8b-803b37b849cc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f543e6b6-b87f-40c3-abbb-9a279fcd8f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Volume volume-21bb2996-6868-4429-9c8b-803b37b849cc (21bb2996-6868-4429-9c8b-803b37b849cc): created successfully Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f543e6b6-b87f-40c3-abbb-9a279fcd8f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (13c9ef2f-1c51-4ce7-9034-e98d46b9b117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0fa829f4-e1c5-4288-bf9d-2d009ac77052 tempest-ProjectMemberTests-243188612 None] Created volume successfully. Sep 30 22:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Creating offline snapshot 400f8c74-babf-44f4-bbe4-1376c3f27462 of volume 21bb2996-6868-4429-9c8b-803b37b849cc {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:36:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda77bc-7bde-437d-96f6-7d4c347da8ec]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:11 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc Sep 30 22:36:11 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:11 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc" returned: 0 in 0.378s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:11 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 1G Sep 30 22:36:11 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:12 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 1G" returned: 0 in 0.498s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21bb2996-6868-4429-9c8b-803b37b849cc -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:12 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21bb2996-6868-4429-9c8b-803b37b849cc -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 Sep 30 22:36:12 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:12 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21bb2996-6868-4429-9c8b-803b37b849cc -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462" returned: 0 in 0.299s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:12 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 is being set with open permissions: ugo+rw Sep 30 22:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:12 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 Sep 30 22:36:12 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:12 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:12 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.info Sep 30 22:36:12 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:12 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.info" returned: 0 in 0.292s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:12 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.info is being set with open permissions: ugo+rw Sep 30 22:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:13 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.info Sep 30 22:36:13 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:13 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.info" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ccad7f42-e15c-42bd-bca8-8ec06f31a6d1 tempest-ProjectMemberTests-243188612 None] Create snapshot completed successfully Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-400f8c74-babf-44f4-bbe4-1376c3f27462-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Lock "cinder-400f8c74-babf-44f4-bbe4-1376c3f27462-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-21bb2996-6868-4429-9c8b-803b37b849cc" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-21bb2996-6868-4429-9c8b-803b37b849cc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-400f8c74-babf-44f4-bbe4-1376c3f27462" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-400f8c74-babf-44f4-bbe4-1376c3f27462" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Deleting offline snapshot 400f8c74-babf-44f4-bbe4-1376c3f27462 of volume 21bb2996-6868-4429-9c8b-803b37b849cc {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] snapshot_file for this snap is: volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdde650c-cd9c-4fb7-b156-cb43421f1876]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:14 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 Sep 30 22:36:14 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:14 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21bb2996-6868-4429-9c8b-803b37b849cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1759579e-9225-4c3d-8821-ab7b4653a01a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:14 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc Sep 30 22:36:14 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:15 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc" returned: 0 in 0.364s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:15 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 Sep 30 22:36:15 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:15 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462" returned: 0 in 0.406s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:15 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462 Sep 30 22:36:15 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:15 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc.400f8c74-babf-44f4-bbe4-1376c3f27462" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-400f8c74-babf-44f4-bbe4-1376c3f27462" released by "_delete_snapshot" :: held 1.478s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-21bb2996-6868-4429-9c8b-803b37b849cc" released by "delete_snapshot" :: held 1.503s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:15 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Created reservations ['08fdebad-009a-4cda-8503-6a4b0fc364ff', '5fb7046e-c137-4d16-b9c4-952c4d12f90e', '03c82057-121e-4395-ba1d-fe3a2c559383', 'd78dcb3a-caae-4099-bcd8-6496b096adea'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Delete snapshot completed successfully. Sep 30 22:36:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1367e0dd-f1d2-4c54-b8a3-7ffea035140d tempest-ProjectMemberTests-243188612 None] Lock "cinder-400f8c74-babf-44f4-bbe4-1376c3f27462-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-21bb2996-6868-4429-9c8b-803b37b849cc-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Lock "cinder-21bb2996-6868-4429-9c8b-803b37b849cc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-21bb2996-6868-4429-9c8b-803b37b849cc" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-21bb2996-6868-4429-9c8b-803b37b849cc" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf4b586-f114-4c77-af4c-21de8227318e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:16 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc Sep 30 22:36:16 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:17 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc" returned: 0 in 0.414s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:17 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc Sep 30 22:36:17 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:17 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-21bb2996-6868-4429-9c8b-803b37b849cc" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-21bb2996-6868-4429-9c8b-803b37b849cc" released by "delete_volume" :: held 0.739s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Created reservations ['e74172a0-ab97-428e-8c07-68c54c99696e', '3c8d1f26-bebb-4e05-96f5-c4a60f073624', 'f921317b-f69b-4089-b733-342df1e501eb', '8cc23188-8b75-479d-8cb7-6c72e4991949'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:17 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:17 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:17 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Deleted volume successfully. Sep 30 22:36:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-55af4bf4-cc36-424e-abcc-d9f77c6852e0 tempest-ProjectMemberTests-243188612 None] Lock "cinder-21bb2996-6868-4429-9c8b-803b37b849cc-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (0a1d45bb-fda0-4a7f-b5c0-e8264070ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7eceb1-48d4-4a4d-b0a1-a11e21b83201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7eceb1-48d4-4a4d-b0a1-a11e21b83201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-957146487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429b8164-7d2e-48bc-a9d5-7ebded3eeca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:18Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0324d46f-9d80-43c2-9e6d-33394b9d4307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0324d46f-9d80-43c2-9e6d-33394b9d4307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6b20ba-dc21-474a-8991-d2b0a6f1e71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6b20ba-dc21-474a-8991-d2b0a6f1e71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429b8164-7d2e-48bc-a9d5-7ebded3eeca4', 'volume_name': 'volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1007340-7915-4e42-9648-f6eeaec576b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1007340-7915-4e42-9648-f6eeaec576b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277a7648-32d2-4534-8afb-16aa8ca7f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Volume 429b8164-7d2e-48bc-a9d5-7ebded3eeca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4', 'volume_size': 1} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-957146487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429b8164-7d2e-48bc-a9d5-7ebded3eeca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:18Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Creating volume 429b8164-7d2e-48bc-a9d5-7ebded3eeca4 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:36:18 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:18 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 1073741824 Sep 30 22:36:18 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:18 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 1073741824" returned: 0 in 0.410s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:18 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 Sep 30 22:36:18 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:18 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277a7648-32d2-4534-8afb-16aa8ca7f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e351f263-7c84-47f3-9c60-e7187f2fa33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:19 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Volume volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 (429b8164-7d2e-48bc-a9d5-7ebded3eeca4): created successfully Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e351f263-7c84-47f3-9c60-e7187f2fa33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (0a1d45bb-fda0-4a7f-b5c0-e8264070ed55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-14173511-7a3d-4019-b0e7-95084bd889fb tempest-ProjectMemberTests-243188612 None] Created volume successfully. Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Creating offline snapshot 2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf of volume 429b8164-7d2e-48bc-a9d5-7ebded3eeca4 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[771e5cbe-c31a-4279-9e34-b05e4bd7bea8]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:19 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 Sep 30 22:36:19 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:19 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" returned: 0 in 0.349s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:19 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf 1G Sep 30 22:36:19 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:20 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf 1G" returned: 0 in 0.382s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:20 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf Sep 30 22:36:20 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:20 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf" returned: 0 in 0.290s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:20 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf is being set with open permissions: ugo+rw Sep 30 22:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:20 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf Sep 30 22:36:20 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:20 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf" returned: 0 in 0.239s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:20 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.info Sep 30 22:36:20 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:20 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.info" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:20 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.info is being set with open permissions: ugo+rw Sep 30 22:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:20 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.info Sep 30 22:36:20 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:21 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.info" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f84e5ad1-8cee-4466-b9ca-edc0908c892e tempest-ProjectMemberTests-243188612 None] Create snapshot completed successfully Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Lock "cinder-2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Deleting offline snapshot 2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf of volume 429b8164-7d2e-48bc-a9d5-7ebded3eeca4 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] snapshot_file for this snap is: volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ccfdea-c94e-4026-9d28-2913e52c0f71]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:21 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf Sep 30 22:36:21 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:21 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf" returned: 0 in 0.349s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7b482a-5327-41f4-addc-8c3b09d82fa1]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:22 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 Sep 30 22:36:22 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:22 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" returned: 0 in 0.355s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:22 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf Sep 30 22:36:22 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:22 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf" returned: 0 in 0.336s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:22 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf Sep 30 22:36:22 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:22 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4.2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf" released by "_delete_snapshot" :: held 1.384s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" released by "delete_snapshot" :: held 1.406s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Created reservations ['f4c1cdc6-0112-46dd-b546-895fc88056c0', '167b9e2d-bbfe-4d53-885a-99a88a0f8953', 'b80ff33e-21d0-401f-860e-0763699f02bf', '11118e09-6932-45b4-aae1-07a2bc8fcb4b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Delete snapshot completed successfully. Sep 30 22:36:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f4df605c-d4b8-4421-b589-7b3d1d997628 tempest-ProjectMemberTests-243188612 None] Lock "cinder-2d7a0988-3c7a-4100-a0f5-5ecf82ed4baf-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-429b8164-7d2e-48bc-a9d5-7ebded3eeca4-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Lock "cinder-429b8164-7d2e-48bc-a9d5-7ebded3eeca4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d06a5a9-6003-42ae-a452-477b63fa3934]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:23 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 Sep 30 22:36:23 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:24 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:24 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4 Sep 30 22:36:24 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:24 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" returned: 0 in 0.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-429b8164-7d2e-48bc-a9d5-7ebded3eeca4" released by "delete_volume" :: held 0.658s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Created reservations ['de0b1c81-60fa-4df2-953f-691fd0e43aec', '4d707d0b-c36c-4d1c-8f26-763c5c219b98', 'f7511c1d-d016-48b1-8a1c-4fb1257eb8eb', 'f7c04352-9561-4774-a0a2-92be32cbbcc1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:24 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:24 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:24 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.250s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Deleted volume successfully. Sep 30 22:36:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49d81f06-320a-478d-8111-af4d981cb7a0 tempest-ProjectMemberTests-243188612 None] Lock "cinder-429b8164-7d2e-48bc-a9d5-7ebded3eeca4-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (6577d400-cd87-4e18-a8c5-73284bd8c409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f739837-f571-45a3-9660-f936db8707cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f739837-f571-45a3-9660-f936db8707cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316503992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc591991-59e1-4101-aca9-a5212f861145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:25Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cf612b-5e74-4401-b676-1ca711ecb658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cf612b-5e74-4401-b676-1ca711ecb658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c5323a-dcec-4b2e-ab05-de64df4f4ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c5323a-dcec-4b2e-ab05-de64df4f4ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc591991-59e1-4101-aca9-a5212f861145', 'volume_name': 'volume-dc591991-59e1-4101-aca9-a5212f861145', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792a52d1-c35c-46c2-8212-03e1803fedca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792a52d1-c35c-46c2-8212-03e1803fedca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9ddfa0-beeb-49fe-b691-5a16507e335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Volume dc591991-59e1-4101-aca9-a5212f861145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc591991-59e1-4101-aca9-a5212f861145', 'volume_size': 1} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316503992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc591991-59e1-4101-aca9-a5212f861145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:25Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Creating volume dc591991-59e1-4101-aca9-a5212f861145 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:36:25 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:25 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 1073741824 Sep 30 22:36:25 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:25 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 1073741824" returned: 0 in 0.398s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:25 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 Sep 30 22:36:25 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:25 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145" returned: 0 in 0.246s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=137,cinder:UPDATE=179,cinder:DELETE=17,cinder:INSERT=46 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9ddfa0-beeb-49fe-b691-5a16507e335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc591991-59e1-4101-aca9-a5212f861145', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f2e6a5-fe8e-4d39-ab77-96b55f5878f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Volume volume-dc591991-59e1-4101-aca9-a5212f861145 (dc591991-59e1-4101-aca9-a5212f861145): created successfully Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f2e6a5-fe8e-4d39-ab77-96b55f5878f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (6577d400-cd87-4e18-a8c5-73284bd8c409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f696abd7-88a4-4c12-a8dc-48499298f7cc tempest-ProjectMemberTests-243188612 None] Created volume successfully. Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=189,cinder:INSERT=50,cinder:SELECT=146,cinder:DELETE=15 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Creating offline snapshot fc92e378-9179-4819-ac63-48826837b992 of volume dc591991-59e1-4101-aca9-a5212f861145 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af7739e-71d6-4fa6-9397-7517b5d8b2ce]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:26 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 Sep 30 22:36:26 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:26 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:26 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 1G Sep 30 22:36:26 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:27 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 1G" returned: 0 in 0.412s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc591991-59e1-4101-aca9-a5212f861145 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:27 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc591991-59e1-4101-aca9-a5212f861145 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 Sep 30 22:36:27 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:27 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc591991-59e1-4101-aca9-a5212f861145 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992" returned: 0 in 0.302s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:27 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 is being set with open permissions: ugo+rw Sep 30 22:36:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:27 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 Sep 30 22:36:27 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:27 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:27 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.info Sep 30 22:36:27 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:28 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.info" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:28 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.info is being set with open permissions: ugo+rw Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:28 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.info Sep 30 22:36:28 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:28 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.info" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e82a6ee3-8afd-4e64-8986-7fe8afdc53cc tempest-ProjectMemberTests-243188612 None] Create snapshot completed successfully Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-fc92e378-9179-4819-ac63-48826837b992-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Lock "cinder-fc92e378-9179-4819-ac63-48826837b992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-dc591991-59e1-4101-aca9-a5212f861145" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-dc591991-59e1-4101-aca9-a5212f861145" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-fc92e378-9179-4819-ac63-48826837b992" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-fc92e378-9179-4819-ac63-48826837b992" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Deleting offline snapshot fc92e378-9179-4819-ac63-48826837b992 of volume dc591991-59e1-4101-aca9-a5212f861145 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] snapshot_file for this snap is: volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08dfaa2-f2f9-4e8b-ab64-a0cbef29bb51]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:28 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 Sep 30 22:36:28 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:28 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992" returned: 0 in 0.352s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc591991-59e1-4101-aca9-a5212f861145(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[85034911-c8d0-4a65-a834-243700140922]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:29 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 Sep 30 22:36:29 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:29 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145" returned: 0 in 0.345s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:29 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 Sep 30 22:36:29 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:29 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992" returned: 0 in 0.321s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:29 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992 Sep 30 22:36:29 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:29 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145.fc92e378-9179-4819-ac63-48826837b992" returned: 0 in 0.238s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-fc92e378-9179-4819-ac63-48826837b992" released by "_delete_snapshot" :: held 1.349s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-dc591991-59e1-4101-aca9-a5212f861145" released by "delete_snapshot" :: held 1.371s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:29 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Created reservations ['be8ecbe5-3c6b-4e17-8dff-9db5463bbc75', '3ef066fe-9528-40da-8fe8-38dc41a88301', '4e12657f-664f-41bc-893d-ea37025638a4', '9b456eb1-885c-48af-8a10-7e4a96e223f6'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Delete snapshot completed successfully. Sep 30 22:36:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8566b422-9c65-4797-9d58-633e0c2cd97a tempest-ProjectMemberTests-243188612 None] Lock "cinder-fc92e378-9179-4819-ac63-48826837b992-delete_snapshot" released by "delete_snapshot" :: held 1.499s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-dc591991-59e1-4101-aca9-a5212f861145-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Lock "cinder-dc591991-59e1-4101-aca9-a5212f861145-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-dc591991-59e1-4101-aca9-a5212f861145" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-dc591991-59e1-4101-aca9-a5212f861145" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a4859b-4e6b-4e64-91eb-0709f81a11f6]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:30 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 Sep 30 22:36:30 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:31 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145" returned: 0 in 0.354s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:31 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145 Sep 30 22:36:31 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:31 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dc591991-59e1-4101-aca9-a5212f861145" returned: 0 in 0.239s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-dc591991-59e1-4101-aca9-a5212f861145" released by "delete_volume" :: held 0.659s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Created reservations ['cb0d5a1a-2339-4c94-9eef-f345e115c4e1', 'cdd5cc2d-485b-4944-ab4c-16e30209545a', '6220c65c-5042-4d28-8142-87bcbab134e1', '32eacc9d-be5d-44dc-adaf-0807b247ea35'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:31 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:31 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:31 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.238s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Deleted volume successfully. Sep 30 22:36:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aae57ab8-1397-4647-97d6-0767f2e0997f tempest-ProjectMemberTests-243188612 None] Lock "cinder-dc591991-59e1-4101-aca9-a5212f861145-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (86a53b14-368d-47fa-a866-d375a926b715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9635bb-1e3d-4d16-b4c3-3e7d8f254ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9635bb-1e3d-4d16-b4c3-3e7d8f254ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233440441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9745a708-6ad5-463d-a9fb-9e6b87ec3dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:32Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50344240-2367-4074-bf67-c6b170bd8d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50344240-2367-4074-bf67-c6b170bd8d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068b0265-2557-400e-aeb4-29de66ba58da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068b0265-2557-400e-aeb4-29de66ba58da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9745a708-6ad5-463d-a9fb-9e6b87ec3dc1', 'volume_name': 'volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7bacaf-5b9b-4436-8203-83d23918f405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7bacaf-5b9b-4436-8203-83d23918f405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea71a49-3f48-49ea-83bb-0853ba045f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Volume 9745a708-6ad5-463d-a9fb-9e6b87ec3dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1', 'volume_size': 1} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233440441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9745a708-6ad5-463d-a9fb-9e6b87ec3dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:32Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Creating volume 9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:36:32 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:32 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 1073741824 Sep 30 22:36:32 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:32 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 1073741824" returned: 0 in 0.417s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:32 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 Sep 30 22:36:32 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:32 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" returned: 0 in 0.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea71a49-3f48-49ea-83bb-0853ba045f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db422bc-62db-4395-a306-fcdbbb11092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Volume volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 (9745a708-6ad5-463d-a9fb-9e6b87ec3dc1): created successfully Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db422bc-62db-4395-a306-fcdbbb11092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (86a53b14-368d-47fa-a866-d375a926b715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:33 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-512a6c9c-170e-415e-813c-aa730ebff8a7 tempest-ProjectMemberTests-243188612 None] Created volume successfully. Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Creating offline snapshot 11417d52-9c7b-40b0-853d-c0331f603bd6 of volume 9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18877d-420f-454b-9bbc-5531e8c41858]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:33 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 Sep 30 22:36:33 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:33 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:33 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 1G Sep 30 22:36:33 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:34 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 1G" returned: 0 in 0.379s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:34 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 Sep 30 22:36:34 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:34 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6" returned: 0 in 0.283s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:34 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 is being set with open permissions: ugo+rw Sep 30 22:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:34 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 Sep 30 22:36:34 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:34 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:34 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.info Sep 30 22:36:34 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:34 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.info" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:34 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.info is being set with open permissions: ugo+rw Sep 30 22:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:34 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.info Sep 30 22:36:34 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:35 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.info" returned: 0 in 0.235s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-35f7ffa6-c742-4077-9afb-9b156aca5599 tempest-ProjectMemberTests-243188612 None] Create snapshot completed successfully Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-11417d52-9c7b-40b0-853d-c0331f603bd6-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Lock "cinder-11417d52-9c7b-40b0-853d-c0331f603bd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-11417d52-9c7b-40b0-853d-c0331f603bd6" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-11417d52-9c7b-40b0-853d-c0331f603bd6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Deleting offline snapshot 11417d52-9c7b-40b0-853d-c0331f603bd6 of volume 9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] snapshot_file for this snap is: volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e5c46e-d932-42cb-8c08-62fd6086129b]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:35 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 Sep 30 22:36:35 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:35 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda96fab-4a2b-4a89-8d4c-b61b19364f0e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:36 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 Sep 30 22:36:36 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:36 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:36 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 Sep 30 22:36:36 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:36 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6" returned: 0 in 0.329s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:36 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6 Sep 30 22:36:36 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:36 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1.11417d52-9c7b-40b0-853d-c0331f603bd6" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-11417d52-9c7b-40b0-853d-c0331f603bd6" released by "_delete_snapshot" :: held 1.378s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" released by "delete_snapshot" :: held 1.400s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:37 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Created reservations ['415da5d6-c00c-4dba-bd8e-d4558538196e', '3ce21c4c-d881-4208-a137-235feda36193', 'f87a2b2a-2728-4502-9550-120d219e7c1d', '66d8e064-c524-4e13-800f-6ea9b6a98241'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Delete snapshot completed successfully. Sep 30 22:36:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6b174284-b91c-4bd0-827b-a0ec41a6780d tempest-ProjectMemberTests-243188612 None] Lock "cinder-11417d52-9c7b-40b0-853d-c0331f603bd6-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Lock "cinder-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb4302c-401d-45d6-be76-8de1889964fd]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:37 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 Sep 30 22:36:37 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:38 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" returned: 0 in 0.350s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:38 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1 Sep 30 22:36:38 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:38 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1" released by "delete_volume" :: held 0.649s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Created reservations ['fe8b1558-e091-4722-a8a8-0c0d47ff174b', 'edf1a32a-da2e-43e7-9ba9-7b1f1284560c', '70ab9ca6-7d68-4b1c-b87d-dda985114622', '36f8b0ad-4f5b-43bd-940e-b7d0980483ae'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:38 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:38 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:38 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Deleted volume successfully. Sep 30 22:36:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76cace2c-ea5d-4944-95e5-ce6478aeb7dc tempest-ProjectMemberTests-243188612 None] Lock "cinder-9745a708-6ad5-463d-a9fb-9e6b87ec3dc1-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (d9c9ca40-4800-48cc-9c15-b8cea176b32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cea0372-d62f-45e0-9264-b93a9cc5411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cea0372-d62f-45e0-9264-b93a9cc5411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356799360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea10f71-ea28-4619-bc3a-eee40e0963e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:39Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b94b258-97fc-4573-8ac1-c5e3f1e7c00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b94b258-97fc-4573-8ac1-c5e3f1e7c00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46d711f-3f6e-45d5-a89a-b67657b9732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46d711f-3f6e-45d5-a89a-b67657b9732e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea10f71-ea28-4619-bc3a-eee40e0963e6', 'volume_name': 'volume-dea10f71-ea28-4619-bc3a-eee40e0963e6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc57297c-14cc-4398-8e20-05181e5e67c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc57297c-14cc-4398-8e20-05181e5e67c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f04510a-95b2-4a51-9c2f-a00638ef9c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Volume dea10f71-ea28-4619-bc3a-eee40e0963e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea10f71-ea28-4619-bc3a-eee40e0963e6', 'volume_size': 1} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356799360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea10f71-ea28-4619-bc3a-eee40e0963e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb17cff9438442499209921d06cc7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:39Z,use_quota=True,user_id='4e5390d733824933adcb080514927c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Creating volume dea10f71-ea28-4619-bc3a-eee40e0963e6 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:36:39 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:39 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 1073741824 Sep 30 22:36:39 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:39 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 1073741824" returned: 0 in 0.400s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:39 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 Sep 30 22:36:39 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:40 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f04510a-95b2-4a51-9c2f-a00638ef9c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea10f71-ea28-4619-bc3a-eee40e0963e6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f57a04e-c45d-4f4f-857c-da5f3152e69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Volume volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 (dea10f71-ea28-4619-bc3a-eee40e0963e6): created successfully Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f57a04e-c45d-4f4f-857c-da5f3152e69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Flow 'volume_create_manager' (d9c9ca40-4800-48cc-9c15-b8cea176b32e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a94b21d1-4ffb-44da-95c9-25da9567f407 tempest-ProjectMemberTests-243188612 None] Created volume successfully. Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Creating offline snapshot 0a22b568-ca8b-4d2e-a82b-2002ed3bfedb of volume dea10f71-ea28-4619-bc3a-eee40e0963e6 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cb43d3-30c4-477f-923b-168f9a6a2d77]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:40 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 Sep 30 22:36:40 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:40 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:40 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb 1G Sep 30 22:36:40 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:41 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb 1G" returned: 0 in 0.375s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:41 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb Sep 30 22:36:41 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:41 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb" returned: 0 in 0.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:41 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb is being set with open permissions: ugo+rw Sep 30 22:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:41 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb Sep 30 22:36:41 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:41 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:41 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.info Sep 30 22:36:41 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:41 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.info" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:41 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.info is being set with open permissions: ugo+rw Sep 30 22:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:42 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.info Sep 30 22:36:42 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:42 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.info" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ccb3e38b-8f04-4d4c-88df-3d1ca7af81e9 tempest-ProjectMemberTests-243188612 None] Create snapshot completed successfully Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-0a22b568-ca8b-4d2e-a82b-2002ed3bfedb-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Lock "cinder-0a22b568-ca8b-4d2e-a82b-2002ed3bfedb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-dea10f71-ea28-4619-bc3a-eee40e0963e6" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-dea10f71-ea28-4619-bc3a-eee40e0963e6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-0a22b568-ca8b-4d2e-a82b-2002ed3bfedb" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-0a22b568-ca8b-4d2e-a82b-2002ed3bfedb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Deleting offline snapshot 0a22b568-ca8b-4d2e-a82b-2002ed3bfedb of volume dea10f71-ea28-4619-bc3a-eee40e0963e6 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] snapshot_file for this snap is: volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26f4028-9fd1-419d-9025-2c6243900d0f]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:42 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb Sep 30 22:36:42 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:43 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dea10f71-ea28-4619-bc3a-eee40e0963e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:36:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7498e-1519-4ba1-ba21-3eb7854f580e]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:43 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 Sep 30 22:36:43 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:43 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6" returned: 0 in 0.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:43 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb Sep 30 22:36:43 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:43 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb" returned: 0 in 0.322s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:43 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb Sep 30 22:36:43 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:43 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6.0a22b568-ca8b-4d2e-a82b-2002ed3bfedb" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-0a22b568-ca8b-4d2e-a82b-2002ed3bfedb" released by "_delete_snapshot" :: held 1.366s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-dea10f71-ea28-4619-bc3a-eee40e0963e6" released by "delete_snapshot" :: held 1.389s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Created reservations ['39906a46-ca74-4dee-94b6-dd32d0ba464c', '22d2ad65-8144-47bf-ac65-7b417f97a914', '391c113c-905c-4e21-9a6a-65957fb76c39', '5fd5fc31-e364-4a69-bbae-f0984c743351'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Delete snapshot completed successfully. Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-17f75bba-1247-493a-b298-0f7782d32743 tempest-ProjectMemberTests-243188612 None] Lock "cinder-0a22b568-ca8b-4d2e-a82b-2002ed3bfedb-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-dea10f71-ea28-4619-bc3a-eee40e0963e6-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Lock "cinder-dea10f71-ea28-4619-bc3a-eee40e0963e6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Acquiring lock "cinder-quobyte-dea10f71-ea28-4619-bc3a-eee40e0963e6" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-dea10f71-ea28-4619-bc3a-eee40e0963e6" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aad81d-eaa3-49d9-adb5-4a9cb86c33f3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:44 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 Sep 30 22:36:44 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:45 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:45 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6 Sep 30 22:36:45 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:45 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-dea10f71-ea28-4619-bc3a-eee40e0963e6" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Lock "cinder-quobyte-dea10f71-ea28-4619-bc3a-eee40e0963e6" released by "delete_volume" :: held 0.650s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Created reservations ['79f23e80-b28c-406f-9ae7-7d8675143a79', '931a5917-2b35-4e7e-8d06-7d173b45e029', 'bc683824-64bf-4a24-b1ff-1957747773da', 'c2d42c87-45e5-4c8a-8e40-b9b9fd2768a8'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:45 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:45 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:45 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Deleted volume successfully. Sep 30 22:36:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e3f3ac9d-142b-41c2-bdc6-3216b1055fdd tempest-ProjectMemberTests-243188612 None] Lock "cinder-dea10f71-ea28-4619-bc3a-eee40e0963e6-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (9799f5c6-e53f-4b71-a6f2-b1efb303234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d296f834-7b2c-4e1e-93b3-a3d78ac54aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d296f834-7b2c-4e1e-93b3-a3d78ac54aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176030093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a10b663-9fe6-44b0-a915-85a4bfd5e777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:49Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2955202c-1c08-4a82-89ec-e84d6e195ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2955202c-1c08-4a82-89ec-e84d6e195ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770310a0-9cb6-48c9-89f2-fd8332c47262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770310a0-9cb6-48c9-89f2-fd8332c47262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a10b663-9fe6-44b0-a915-85a4bfd5e777', 'volume_name': 'volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc15cf2b-fe24-4256-9d05-6c983e2f2bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc15cf2b-fe24-4256-9d05-6c983e2f2bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fabc51-0532-4b67-ab6f-ed2fa8124412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Volume 3a10b663-9fe6-44b0-a915-85a4bfd5e777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777', 'volume_size': 1} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176030093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a10b663-9fe6-44b0-a915-85a4bfd5e777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:49Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Creating volume 3a10b663-9fe6-44b0-a915-85a4bfd5e777 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:36:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:49 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 1073741824 Sep 30 22:36:49 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:49 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 1073741824" returned: 0 in 0.411s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:49 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 Sep 30 22:36:49 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:50 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fabc51-0532-4b67-ab6f-ed2fa8124412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105461be-6ab1-4c1f-9a8e-07f7612dff07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Volume volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 (3a10b663-9fe6-44b0-a915-85a4bfd5e777): created successfully Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105461be-6ab1-4c1f-9a8e-07f7612dff07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (9799f5c6-e53f-4b71-a6f2-b1efb303234a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-02e3b813-7dab-4ae3-88ba-d43c04360d45 tempest-ProjectReaderTests-1242881239 None] Created volume successfully. Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Creating offline snapshot c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 of volume 3a10b663-9fe6-44b0-a915-85a4bfd5e777 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[28417fb3-b8e7-40fd-b1b0-cbcde53caa99]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:50 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 Sep 30 22:36:50 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:50 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:50 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 1G Sep 30 22:36:50 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:51 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 1G" returned: 0 in 0.385s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:51 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 Sep 30 22:36:51 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:51 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4" returned: 0 in 0.284s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:51 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 is being set with open permissions: ugo+rw Sep 30 22:36:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:51 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 Sep 30 22:36:51 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:51 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:51 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.info Sep 30 22:36:51 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:52 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.info" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:52 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.info is being set with open permissions: ugo+rw Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:52 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.info Sep 30 22:36:52 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:52 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.info" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7e1cad9f-191e-46aa-9e34-b764b3fe425a tempest-ProjectReaderTests-1242881239 None] Create snapshot completed successfully Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-c7fbd492-d1ac-45dd-9ba5-d7642392d6e4-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-c7fbd492-d1ac-45dd-9ba5-d7642392d6e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-3a10b663-9fe6-44b0-a915-85a4bfd5e777" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-3a10b663-9fe6-44b0-a915-85a4bfd5e777" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-c7fbd492-d1ac-45dd-9ba5-d7642392d6e4" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-c7fbd492-d1ac-45dd-9ba5-d7642392d6e4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Deleting offline snapshot c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 of volume 3a10b663-9fe6-44b0-a915-85a4bfd5e777 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] snapshot_file for this snap is: volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f888ab55-db91-4e4a-bd8a-1e6690b9cfb1]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:52 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 Sep 30 22:36:52 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:53 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4" returned: 0 in 0.343s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:36:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffc7464-face-4798-935d-e306a36c16aa]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:53 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 Sep 30 22:36:53 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:53 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777" returned: 0 in 0.344s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:53 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 Sep 30 22:36:53 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:53 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4" returned: 0 in 0.335s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:53 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4 Sep 30 22:36:53 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:54 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777.c7fbd492-d1ac-45dd-9ba5-d7642392d6e4" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-c7fbd492-d1ac-45dd-9ba5-d7642392d6e4" released by "_delete_snapshot" :: held 1.352s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-3a10b663-9fe6-44b0-a915-85a4bfd5e777" released by "delete_snapshot" :: held 1.375s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Created reservations ['7cdf6026-438b-45d8-a46d-f7d655e66e40', 'c331cc27-5208-409b-a4ab-6450ce5ef2d0', 'c64ad6a3-2e2d-4c9f-b962-3c9db054c0fe', 'd661ea84-7d57-49ef-a12d-a524d7d9a3c9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Delete snapshot completed successfully. Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-42c22aaf-d01d-4ec0-9b73-352a06140e30 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-c7fbd492-d1ac-45dd-9ba5-d7642392d6e4-delete_snapshot" released by "delete_snapshot" :: held 1.495s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-3a10b663-9fe6-44b0-a915-85a4bfd5e777-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-3a10b663-9fe6-44b0-a915-85a4bfd5e777-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-3a10b663-9fe6-44b0-a915-85a4bfd5e777" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-3a10b663-9fe6-44b0-a915-85a4bfd5e777" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b011da-f010-41ae-acd8-9b459d6708c8]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:55 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 Sep 30 22:36:55 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:55 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777" returned: 0 in 0.352s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:55 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777 Sep 30 22:36:55 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:55 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-3a10b663-9fe6-44b0-a915-85a4bfd5e777" returned: 0 in 0.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-3a10b663-9fe6-44b0-a915-85a4bfd5e777" released by "delete_volume" :: held 0.652s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Created reservations ['17d0c09d-6235-451f-b570-54cdba362d67', '12d220a0-4c67-424e-8761-665a0bd8b3d3', '9a4b2eb6-8973-493b-9bf5-19956d26cb44', '136a8e67-19ee-4dc0-8686-0a0274fdf638'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:55 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:36:55 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:55 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.254s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:55 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:36:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Deleted volume successfully. Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-81a417fa-d3ff-473b-a037-6c3e3bd0ee07 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-3a10b663-9fe6-44b0-a915-85a4bfd5e777-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (f9913fc5-967a-425f-857f-3bddff0d0dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deaf8857-4d65-4993-b109-5f6a1e4f0294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deaf8857-4d65-4993-b109-5f6a1e4f0294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504116293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:56Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731b29b0-6d62-4309-8838-aa7ca382bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731b29b0-6d62-4309-8838-aa7ca382bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c600e8-e931-4734-8555-1fb90a36f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c600e8-e931-4734-8555-1fb90a36f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9', 'volume_name': 'volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdcefa2-3c29-4a3d-970f-c4e8d8ee84f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdcefa2-3c29-4a3d-970f-c4e8d8ee84f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24656d4-ff08-41df-8c37-685469303938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Volume 5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9', 'volume_size': 1} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504116293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:36:56Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Creating volume 5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:36:56 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:56 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 1073741824 Sep 30 22:36:56 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:56 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 1073741824" returned: 0 in 0.410s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:56 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 Sep 30 22:36:56 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:57 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24656d4-ff08-41df-8c37-685469303938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3775fad5-eaf6-4dc9-82a0-37f873bfb6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:36:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Volume volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 (5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9): created successfully Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3775fad5-eaf6-4dc9-82a0-37f873bfb6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (f9913fc5-967a-425f-857f-3bddff0d0dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:36:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e4fa25a2-c642-4c4e-9f78-33f05b8c43fa tempest-ProjectReaderTests-1242881239 None] Created volume successfully. Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Creating offline snapshot 639784bd-7528-40f5-aaad-2da4ebc9fa25 of volume 5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[176e96f6-0c35-462b-b0e7-4ab4f0cfdb57]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:57 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 Sep 30 22:36:57 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:57 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" returned: 0 in 0.363s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:57 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 1G Sep 30 22:36:57 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:58 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 1G" returned: 0 in 0.383s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:58 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 Sep 30 22:36:58 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:58 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25" returned: 0 in 0.284s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:58 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 is being set with open permissions: ugo+rw Sep 30 22:36:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:58 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 Sep 30 22:36:58 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:58 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25" returned: 0 in 0.239s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:58 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.info Sep 30 22:36:58 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:59 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.info" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:59 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.info is being set with open permissions: ugo+rw Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:59 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.info Sep 30 22:36:59 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:36:59 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.info" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:36:59 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ffd02dab-2a66-4981-b49e-f3f0ba4df9df tempest-ProjectReaderTests-1242881239 None] Create snapshot completed successfully Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-639784bd-7528-40f5-aaad-2da4ebc9fa25-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-639784bd-7528-40f5-aaad-2da4ebc9fa25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-639784bd-7528-40f5-aaad-2da4ebc9fa25" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-639784bd-7528-40f5-aaad-2da4ebc9fa25" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Deleting offline snapshot 639784bd-7528-40f5-aaad-2da4ebc9fa25 of volume 5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] snapshot_file for this snap is: volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b3bf44-511d-4cef-a334-d80d745b9cf3]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:36:59 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 Sep 30 22:36:59 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:00 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25" returned: 0 in 0.350s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:37:00 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ee3984-82a0-4e9a-a6c5-bd906a105492]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:00 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 Sep 30 22:37:00 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:00 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" returned: 0 in 0.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:00 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 Sep 30 22:37:00 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:00 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25" returned: 0 in 0.333s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:00 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25 Sep 30 22:37:00 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:01 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9.639784bd-7528-40f5-aaad-2da4ebc9fa25" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-639784bd-7528-40f5-aaad-2da4ebc9fa25" released by "_delete_snapshot" :: held 1.356s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" released by "delete_snapshot" :: held 1.375s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Created reservations ['eafdbea5-a707-405e-af8c-fcc317dcabba', '401cbb95-e188-459c-af44-18198a8fe1fa', '35bc4045-2d3d-4cad-a78a-d13d2adb03fe', '17f4029c-2412-4cf9-8947-83267fb4e40d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Delete snapshot completed successfully. Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f014e0c-905f-493f-b3bf-056d8612a4f0 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-639784bd-7528-40f5-aaad-2da4ebc9fa25-delete_snapshot" released by "delete_snapshot" :: held 1.498s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b44b3-12e1-4860-9dbc-7cc803e4ee69]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:02 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 Sep 30 22:37:02 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:02 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:02 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9 Sep 30 22:37:02 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:02 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9" released by "delete_volume" :: held 0.656s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Created reservations ['ee218209-3b55-49d5-aa76-c74c360dcf53', 'd60710de-48c1-4d28-b463-086ee6c4e768', '6d122ad2-1523-41c4-979e-b72f423317b2', 'd37c1738-7d58-4142-a1b4-92f2569730d1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:02 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:37:02 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:02 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.259s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:37:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Deleted volume successfully. Sep 30 22:37:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-eadb4811-e543-4f71-ae88-5aa4fd7ca6f7 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-5dba2d0b-9afa-4d2e-b0d7-6ce8bbb4b1e9-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:03 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:37:03 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:03 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.255s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (5f5e238a-12f5-4f25-b5a5-e4e9ef927f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbf45c2-5902-40db-999c-3adfe362c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbf45c2-5902-40db-999c-3adfe362c115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187889008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c465426-7fed-456f-a7a5-fa3282bc4e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:03Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a70970-3b30-40c6-b99d-0747f6696a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a70970-3b30-40c6-b99d-0747f6696a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63829ba-d86f-4853-b48e-775fc8c248e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63829ba-d86f-4853-b48e-775fc8c248e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c465426-7fed-456f-a7a5-fa3282bc4e1a', 'volume_name': 'volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7d0ab8-4834-41fb-bd12-2813bcd9b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7d0ab8-4834-41fb-bd12-2813bcd9b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32fdb4e-0bc1-45f4-8362-e4537b7c2bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Volume 5c465426-7fed-456f-a7a5-fa3282bc4e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a', 'volume_size': 1} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187889008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c465426-7fed-456f-a7a5-fa3282bc4e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:03Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Creating volume 5c465426-7fed-456f-a7a5-fa3282bc4e1a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:37:03 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:03 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a 1073741824 Sep 30 22:37:03 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:03 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a 1073741824" returned: 0 in 0.403s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:04 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a Sep 30 22:37:04 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:04 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a" returned: 0 in 0.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32fdb4e-0bc1-45f4-8362-e4537b7c2bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922d5a5b-b0fe-4837-9849-927efae137dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Volume volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a (5c465426-7fed-456f-a7a5-fa3282bc4e1a): created successfully Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922d5a5b-b0fe-4837-9849-927efae137dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (5f5e238a-12f5-4f25-b5a5-e4e9ef927f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a72c9eee-a48d-49bb-931b-01822d4be571 tempest-ProjectReaderTests-1242881239 None] Created volume successfully. Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Creating offline snapshot 96ecb46a-6998-447a-a709-d0d798d8b5af of volume 5c465426-7fed-456f-a7a5-fa3282bc4e1a {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f417b1-b4f6-465a-a240-86fd1d7417c4]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:04 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a Sep 30 22:37:04 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:04 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a" returned: 0 in 0.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:05 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af 1G Sep 30 22:37:05 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:05 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af 1G" returned: 0 in 0.387s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:05 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af Sep 30 22:37:05 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:05 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af" returned: 0 in 0.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:05 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af is being set with open permissions: ugo+rw Sep 30 22:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:05 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af Sep 30 22:37:05 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:05 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:05 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.info Sep 30 22:37:05 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:06 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.info" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:06 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.info is being set with open permissions: ugo+rw Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:06 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.info Sep 30 22:37:06 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:06 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.info" returned: 0 in 0.246s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-24d31a37-7902-4388-996a-0dc170cce5c7 tempest-ProjectReaderTests-1242881239 None] Create snapshot completed successfully Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-96ecb46a-6998-447a-a709-d0d798d8b5af-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Lock "cinder-96ecb46a-6998-447a-a709-d0d798d8b5af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-5c465426-7fed-456f-a7a5-fa3282bc4e1a" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-5c465426-7fed-456f-a7a5-fa3282bc4e1a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-96ecb46a-6998-447a-a709-d0d798d8b5af" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-96ecb46a-6998-447a-a709-d0d798d8b5af" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Deleting offline snapshot 96ecb46a-6998-447a-a709-d0d798d8b5af of volume 5c465426-7fed-456f-a7a5-fa3282bc4e1a {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] snapshot_file for this snap is: volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[15da873a-5928-42dc-b16e-7eec42476522]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:06 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af Sep 30 22:37:06 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:07 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af" returned: 0 in 0.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:37:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4663c-a680-48fc-961c-ac1ad5865b84]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:07 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a Sep 30 22:37:07 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:07 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a" returned: 0 in 0.354s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:07 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af Sep 30 22:37:07 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:07 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af" returned: 0 in 0.329s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:07 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af Sep 30 22:37:07 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:08 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a.96ecb46a-6998-447a-a709-d0d798d8b5af" returned: 0 in 0.238s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-96ecb46a-6998-447a-a709-d0d798d8b5af" released by "_delete_snapshot" :: held 1.373s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-5c465426-7fed-456f-a7a5-fa3282bc4e1a" released by "delete_snapshot" :: held 1.395s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:08 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Created reservations ['fdada642-5d45-45ef-8b69-70d619a5673d', '0841e2a4-31fa-41d4-94c1-e8ef3ae9f373', 'a867437e-5542-457a-ae82-29b5bc75ce5c', 'f6f5a1dc-3dda-4eb1-986c-3f573867a0a7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Delete snapshot completed successfully. Sep 30 22:37:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1464cf6a-c673-45e9-bdd5-fa24caa974ee tempest-ProjectReaderTests-1242881239 None] Lock "cinder-96ecb46a-6998-447a-a709-d0d798d8b5af-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-5c465426-7fed-456f-a7a5-fa3282bc4e1a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-5c465426-7fed-456f-a7a5-fa3282bc4e1a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-5c465426-7fed-456f-a7a5-fa3282bc4e1a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-5c465426-7fed-456f-a7a5-fa3282bc4e1a" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef31fb8-0451-493e-8a3a-21b4c8bcde35]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:09 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a Sep 30 22:37:09 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:09 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a" returned: 0 in 0.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:09 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a Sep 30 22:37:09 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:09 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-5c465426-7fed-456f-a7a5-fa3282bc4e1a" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-5c465426-7fed-456f-a7a5-fa3282bc4e1a" released by "delete_volume" :: held 0.649s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Created reservations ['da356f96-62aa-4e91-ba70-e8420020d817', 'd8574718-953a-4a25-b8f8-ce8319c78b3d', '52f59a64-41d9-4b5e-87b6-1a8baa73e7a3', '04702359-0609-4d83-a39b-e350c21a8f09'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:09 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:37:09 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:09 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:37:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Deleted volume successfully. Sep 30 22:37:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b91875b-d304-4a3f-a4e6-a30a9b4fe7f9 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-5c465426-7fed-456f-a7a5-fa3282bc4e1a-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (2258e47a-9dbc-483b-8686-a219900454b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de78af8-73ea-41d0-938b-2c8676c90a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de78af8-73ea-41d0-938b-2c8676c90a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1111906268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d8af66-f392-4e2e-be85-f3d0f874a57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:10Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc5d673-8070-47cf-8bf8-482ad575b9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc5d673-8070-47cf-8bf8-482ad575b9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ac52e-7472-4150-9cec-9ce82842c49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ac52e-7472-4150-9cec-9ce82842c49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d8af66-f392-4e2e-be85-f3d0f874a57d', 'volume_name': 'volume-47d8af66-f392-4e2e-be85-f3d0f874a57d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f27b53-0240-4e3d-ad0c-36f1da7405cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f27b53-0240-4e3d-ad0c-36f1da7405cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9eed28-cd5c-4e86-b435-016267fdbbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Volume 47d8af66-f392-4e2e-be85-f3d0f874a57d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d8af66-f392-4e2e-be85-f3d0f874a57d', 'volume_size': 1} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1111906268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d8af66-f392-4e2e-be85-f3d0f874a57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:10Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Creating volume 47d8af66-f392-4e2e-be85-f3d0f874a57d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:37:10 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:10 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d 1073741824 Sep 30 22:37:10 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:10 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d 1073741824" returned: 0 in 0.404s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:11 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d Sep 30 22:37:11 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:11 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d" returned: 0 in 0.238s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9eed28-cd5c-4e86-b435-016267fdbbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d8af66-f392-4e2e-be85-f3d0f874a57d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b257da05-6907-47b9-9a96-1fccb72ab62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Volume volume-47d8af66-f392-4e2e-be85-f3d0f874a57d (47d8af66-f392-4e2e-be85-f3d0f874a57d): created successfully Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b257da05-6907-47b9-9a96-1fccb72ab62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (2258e47a-9dbc-483b-8686-a219900454b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-cd636a75-2d9b-4ba6-8589-ef00faa7d0f5 tempest-ProjectReaderTests-1242881239 None] Created volume successfully. Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Creating offline snapshot 28b98f35-bdf0-456c-b003-e2d211e368d9 of volume 47d8af66-f392-4e2e-be85-f3d0f874a57d {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f72b05-dbf9-4149-a4e7-67e8041f4b7a]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:11 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d Sep 30 22:37:11 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:12 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d" returned: 0 in 0.363s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:12 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 1G Sep 30 22:37:12 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:12 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 1G" returned: 0 in 0.398s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d8af66-f392-4e2e-be85-f3d0f874a57d -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:12 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d8af66-f392-4e2e-be85-f3d0f874a57d -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 Sep 30 22:37:12 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:12 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d8af66-f392-4e2e-be85-f3d0f874a57d -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9" returned: 0 in 0.285s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:12 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 is being set with open permissions: ugo+rw Sep 30 22:37:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:12 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 Sep 30 22:37:12 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:12 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9" returned: 0 in 0.252s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:13 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.info Sep 30 22:37:13 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:13 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.info" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:13 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.info is being set with open permissions: ugo+rw Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:13 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.info Sep 30 22:37:13 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:13 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.info" returned: 0 in 0.241s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3a8cac1e-0dad-474c-98ec-b5c121f019ea tempest-ProjectReaderTests-1242881239 None] Create snapshot completed successfully Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-28b98f35-bdf0-456c-b003-e2d211e368d9-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Lock "cinder-28b98f35-bdf0-456c-b003-e2d211e368d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-47d8af66-f392-4e2e-be85-f3d0f874a57d" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-47d8af66-f392-4e2e-be85-f3d0f874a57d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-28b98f35-bdf0-456c-b003-e2d211e368d9" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-28b98f35-bdf0-456c-b003-e2d211e368d9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Deleting offline snapshot 28b98f35-bdf0-456c-b003-e2d211e368d9 of volume 47d8af66-f392-4e2e-be85-f3d0f874a57d {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] snapshot_file for this snap is: volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5555fe5e-44e1-46e9-aa57-060cd7491c73]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:13 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 Sep 30 22:37:13 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:14 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9" returned: 0 in 0.349s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d8af66-f392-4e2e-be85-f3d0f874a57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:37:14 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb0915d-04db-4ef0-bd7f-592fe480940d]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:14 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d Sep 30 22:37:14 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:14 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d" returned: 0 in 0.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:14 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 Sep 30 22:37:14 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:14 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9" returned: 0 in 0.329s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:14 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9 Sep 30 22:37:14 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:15 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d.28b98f35-bdf0-456c-b003-e2d211e368d9" returned: 0 in 0.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-28b98f35-bdf0-456c-b003-e2d211e368d9" released by "_delete_snapshot" :: held 1.369s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-47d8af66-f392-4e2e-be85-f3d0f874a57d" released by "delete_snapshot" :: held 1.388s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Created reservations ['5010748a-cdbe-48fc-98f0-81e1cc4e0e5c', '38908427-689f-46ba-b9fb-7a5ba99f56af', '7c750e48-8960-455e-b28c-ab08672d4385', '31eaae30-59de-4c06-a956-9afddbf0297c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Delete snapshot completed successfully. Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0bf9aefa-866b-455e-9d62-b7c3b11088ef tempest-ProjectReaderTests-1242881239 None] Lock "cinder-28b98f35-bdf0-456c-b003-e2d211e368d9-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-47d8af66-f392-4e2e-be85-f3d0f874a57d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Lock "cinder-47d8af66-f392-4e2e-be85-f3d0f874a57d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-47d8af66-f392-4e2e-be85-f3d0f874a57d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-47d8af66-f392-4e2e-be85-f3d0f874a57d" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c85f712-9d29-4890-be8e-36b45c249586]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:16 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d Sep 30 22:37:16 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:16 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d" returned: 0 in 0.373s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:16 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d Sep 30 22:37:16 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:16 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-47d8af66-f392-4e2e-be85-f3d0f874a57d" returned: 0 in 0.248s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-47d8af66-f392-4e2e-be85-f3d0f874a57d" released by "delete_volume" :: held 0.679s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Created reservations ['2dc4a6a0-0704-4ad8-bc3a-460e917f0168', '212f6edc-7012-4d91-b08d-ff9ed69c2a60', '0d304503-bc11-4a8a-a1cd-63effd5c48b0', 'be3e6779-3201-4ed7-b148-a23942a8e817'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:16 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:37:16 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:16 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:37:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Deleted volume successfully. Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5c6c894c-b93b-4d23-8a82-2672e1ea28bf tempest-ProjectReaderTests-1242881239 None] Lock "cinder-47d8af66-f392-4e2e-be85-f3d0f874a57d-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (7ee2976e-65c7-433c-aa8b-423fa0f02245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75e63aa-40bf-4d90-a542-de8b80166a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75e63aa-40bf-4d90-a542-de8b80166a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1561775280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029c07aa-7e76-43f7-9850-bd17691a784f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:17Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa38c10-aadc-44b2-9f2d-0641a966761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa38c10-aadc-44b2-9f2d-0641a966761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0624b7f-a992-4aa5-959b-2d03d5d72b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0624b7f-a992-4aa5-959b-2d03d5d72b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '029c07aa-7e76-43f7-9850-bd17691a784f', 'volume_name': 'volume-029c07aa-7e76-43f7-9850-bd17691a784f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641a7dfa-e2ad-4e3b-9501-e72a85964f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641a7dfa-e2ad-4e3b-9501-e72a85964f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca4a685-f22f-43b4-add4-b86c5df536fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:17 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Volume 029c07aa-7e76-43f7-9850-bd17691a784f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-029c07aa-7e76-43f7-9850-bd17691a784f', 'volume_size': 1} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1561775280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029c07aa-7e76-43f7-9850-bd17691a784f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c897a97b45c427eaf17b9859eeee739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:17Z,use_quota=True,user_id='b12af96e8f5f42f79db608ef637e9d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Creating volume 029c07aa-7e76-43f7-9850-bd17691a784f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:37:17 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:17 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f 1073741824 Sep 30 22:37:17 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:17 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f 1073741824" returned: 0 in 0.408s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:18 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f Sep 30 22:37:18 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:18 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f" returned: 0 in 0.240s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca4a685-f22f-43b4-add4-b86c5df536fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-029c07aa-7e76-43f7-9850-bd17691a784f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baefa527-30e5-47d4-8243-7c07587e363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Volume volume-029c07aa-7e76-43f7-9850-bd17691a784f (029c07aa-7e76-43f7-9850-bd17691a784f): created successfully Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baefa527-30e5-47d4-8243-7c07587e363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Flow 'volume_create_manager' (7ee2976e-65c7-433c-aa8b-423fa0f02245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b569209d-777e-4e92-8b27-eabebe03a198 tempest-ProjectReaderTests-1242881239 None] Created volume successfully. Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Creating offline snapshot c5462123-4487-46a0-9dc5-1bb56801fc11 of volume 029c07aa-7e76-43f7-9850-bd17691a784f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2259a3b5-bb4c-4c7a-aa22-b772453b9eb9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:18 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f Sep 30 22:37:18 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:19 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f" returned: 0 in 0.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:19 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 1G Sep 30 22:37:19 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:19 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 1G" returned: 0 in 0.381s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-029c07aa-7e76-43f7-9850-bd17691a784f -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:19 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-029c07aa-7e76-43f7-9850-bd17691a784f -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 Sep 30 22:37:19 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:19 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-029c07aa-7e76-43f7-9850-bd17691a784f -F qcow2 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11" returned: 0 in 0.288s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:19 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 is being set with open permissions: ugo+rw Sep 30 22:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:19 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 Sep 30 22:37:19 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:19 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11" returned: 0 in 0.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:19 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.info Sep 30 22:37:19 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:20 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.info" returned: 0 in 0.246s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:20 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.info is being set with open permissions: ugo+rw Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:20 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.info Sep 30 22:37:20 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:20 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.info" returned: 0 in 0.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-68aec630-2c2b-47f5-9fde-62c72892a9c1 tempest-ProjectReaderTests-1242881239 None] Create snapshot completed successfully Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-c5462123-4487-46a0-9dc5-1bb56801fc11-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-c5462123-4487-46a0-9dc5-1bb56801fc11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-029c07aa-7e76-43f7-9850-bd17691a784f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-029c07aa-7e76-43f7-9850-bd17691a784f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-c5462123-4487-46a0-9dc5-1bb56801fc11" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-c5462123-4487-46a0-9dc5-1bb56801fc11" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Deleting offline snapshot c5462123-4487-46a0-9dc5-1bb56801fc11 of volume 029c07aa-7e76-43f7-9850-bd17691a784f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] snapshot_file for this snap is: volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d872f878-9617-4eb4-b274-d4af243be1ca]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:20 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 Sep 30 22:37:20 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:21 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11" returned: 0 in 0.359s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-029c07aa-7e76-43f7-9850-bd17691a784f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 30 22:37:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[333b0ba7-ab9d-4024-b9c5-847b0196b1a9]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:21 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f Sep 30 22:37:21 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:21 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f" returned: 0 in 0.346s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:21 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 Sep 30 22:37:21 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:21 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11" returned: 0 in 0.316s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:21 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11 Sep 30 22:37:21 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:22 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f.c5462123-4487-46a0-9dc5-1bb56801fc11" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-c5462123-4487-46a0-9dc5-1bb56801fc11" released by "_delete_snapshot" :: held 1.346s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-029c07aa-7e76-43f7-9850-bd17691a784f" released by "delete_snapshot" :: held 1.366s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Created reservations ['867811c6-ee20-487e-878c-627e27dd1dac', 'c5953d84-5307-4cad-8434-bf2fed42f924', '0ef59073-68b2-4f37-babf-d433992a08f3', '2d33d560-119f-4b13-93b2-1fc3ea712d45'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Delete snapshot completed successfully. Sep 30 22:37:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d82ce27d-bfac-42e4-9114-46e9136f5399 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-c5462123-4487-46a0-9dc5-1bb56801fc11-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-029c07aa-7e76-43f7-9850-bd17691a784f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-029c07aa-7e76-43f7-9850-bd17691a784f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "cinder-quobyte-029c07aa-7e76-43f7-9850-bd17691a784f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-029c07aa-7e76-43f7-9850-bd17691a784f" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c68ddab-c64a-4127-89cd-79e716071054]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:23 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f Sep 30 22:37:23 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:23 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f" returned: 0 in 0.346s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:23 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f Sep 30 22:37:23 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:23 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-029c07aa-7e76-43f7-9850-bd17691a784f" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-quobyte-029c07aa-7e76-43f7-9850-bd17691a784f" released by "delete_volume" :: held 0.637s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Created reservations ['1ba83c34-3722-40f4-9516-cad0dae6e6ac', '2b5a1773-20ed-4f46-ac94-3f7e5d196fdc', 'fe049237-28d2-4186-b751-63333e39b81b', '8605b19f-c155-4fae-b664-62881484acac'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:23 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:37:23 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:23 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.236s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:37:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Deleted volume successfully. Sep 30 22:37:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1fedb5f0-148d-420e-902a-8983edf39e59 tempest-ProjectReaderTests-1242881239 None] Lock "cinder-029c07aa-7e76-43f7-9850-bd17691a784f-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:33 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=114,cinder:UPDATE=149,cinder:DELETE=11,cinder:INSERT=37 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:37:33 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=133,cinder:SELECT=106,cinder:INSERT=42,cinder:DELETE=12 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Flow 'volume_create_manager' (797a779e-49af-433d-bc41-535d40291415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c44a675-1e1a-4278-a489-4ff43d5b2880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c44a675-1e1a-4278-a489-4ff43d5b2880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692829385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a29d55d-5a54-44dd-8d8a-793dd538a34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d0fbf7b3dc47fcb68fb67696f899b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:36Z,use_quota=True,user_id='fff3a6738a27434ebf819e34a6d7e379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014f7044-bea3-43f8-b1ae-1ad2e9c03469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014f7044-bea3-43f8-b1ae-1ad2e9c03469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e927ac-8722-48d3-b04d-f6c4c5f288c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e927ac-8722-48d3-b04d-f6c4c5f288c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a29d55d-5a54-44dd-8d8a-793dd538a34d', 'volume_name': 'volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf91d8df-8704-429f-a55f-ef68fa16d739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf91d8df-8704-429f-a55f-ef68fa16d739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b73658d-c85e-48a6-b617-73d58a858901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Volume 9a29d55d-5a54-44dd-8d8a-793dd538a34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d', 'volume_size': 1} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692829385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a29d55d-5a54-44dd-8d8a-793dd538a34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d0fbf7b3dc47fcb68fb67696f899b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:36Z,use_quota=True,user_id='fff3a6738a27434ebf819e34a6d7e379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Creating volume 9a29d55d-5a54-44dd-8d8a-793dd538a34d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:37:35 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:35 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d 1073741824 Sep 30 22:37:35 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:36 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d 1073741824" returned: 0 in 0.389s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:36 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d Sep 30 22:37:36 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:36 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d" returned: 0 in 0.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b73658d-c85e-48a6-b617-73d58a858901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0836601-c6a1-4c5f-a0d4-3f541e3c9a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Volume volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d (9a29d55d-5a54-44dd-8d8a-793dd538a34d): created successfully Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0836601-c6a1-4c5f-a0d4-3f541e3c9a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Flow 'volume_create_manager' (797a779e-49af-433d-bc41-535d40291415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-464a96fb-7e19-4ae3-8ba6-a36fa8e71540 tempest-ProjectReaderTests-949744717 None] Created volume successfully. Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Acquiring lock "cinder-9a29d55d-5a54-44dd-8d8a-793dd538a34d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Lock "cinder-9a29d55d-5a54-44dd-8d8a-793dd538a34d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Acquiring lock "cinder-quobyte-9a29d55d-5a54-44dd-8d8a-793dd538a34d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Lock "cinder-quobyte-9a29d55d-5a54-44dd-8d8a-793dd538a34d" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90e45af-52b0-4b4b-b2cb-5340883ae803]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:37 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d Sep 30 22:37:37 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:37 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d" returned: 0 in 0.350s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:37 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d Sep 30 22:37:37 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:37 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-9a29d55d-5a54-44dd-8d8a-793dd538a34d" returned: 0 in 0.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Lock "cinder-quobyte-9a29d55d-5a54-44dd-8d8a-793dd538a34d" released by "delete_volume" :: held 0.629s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Created reservations ['cc1b3a5a-af13-4bea-a5f3-3d8f18ff8fdf', '24e1e634-263c-45fb-b45b-d0b3634dfe1a', 'aeaa3875-4c60-4b40-88a1-95e5b8004fe6', '4fcd90f5-5e1d-483e-9ea4-ebac375aff99'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:37 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:37:37 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:37 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.233s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:37:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Deleted volume successfully. Sep 30 22:37:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bcb5066e-a28d-440e-a902-55f6e2473d55 tempest-ProjectReaderTests-949744717 None] Lock "cinder-9a29d55d-5a54-44dd-8d8a-793dd538a34d-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Flow 'volume_create_manager' (c027fcef-334d-45d1-a48e-aec5e8dba276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f1fe4d-58e6-4035-87c5-4ba0f8293ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f1fe4d-58e6-4035-87c5-4ba0f8293ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1333119459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52eae3f-e0cb-4b66-b97a-f832aab34331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d0fbf7b3dc47fcb68fb67696f899b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:38Z,use_quota=True,user_id='fff3a6738a27434ebf819e34a6d7e379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180ac715-f538-4a6b-a369-bd4d3698f5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180ac715-f538-4a6b-a369-bd4d3698f5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3025394-ea2f-46f8-9035-82eb99520f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3025394-ea2f-46f8-9035-82eb99520f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52eae3f-e0cb-4b66-b97a-f832aab34331', 'volume_name': 'volume-f52eae3f-e0cb-4b66-b97a-f832aab34331', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ab94a7-fdb7-4b9b-b05f-a929a5f4dc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04ab94a7-fdb7-4b9b-b05f-a929a5f4dc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b34e84e-7d20-453d-acad-1a01d4412e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Volume f52eae3f-e0cb-4b66-b97a-f832aab34331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52eae3f-e0cb-4b66-b97a-f832aab34331', 'volume_size': 1} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-30T20:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1333119459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52eae3f-e0cb-4b66-b97a-f832aab34331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00d0fbf7b3dc47fcb68fb67696f899b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-30T20:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-30T20:37:38Z,use_quota=True,user_id='fff3a6738a27434ebf819e34a6d7e379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79f552f-7582-4cfc-9c0a-0ac67ba67210),volume_type_id=f79f552f-7582-4cfc-9c0a-0ac67ba67210)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Creating volume f52eae3f-e0cb-4b66-b97a-f832aab34331 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Selected osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 30 22:37:38 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] casted to osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816 Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:38 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 1073741824 Sep 30 22:37:38 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:38 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 1073741824" returned: 0 in 0.394s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:39 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 Sep 30 22:37:39 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:39 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331" returned: 0 in 0.234s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b34e84e-7d20-453d-acad-1a01d4412e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52eae3f-e0cb-4b66-b97a-f832aab34331', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b94f2eb-b3aa-4147-a29c-3e096df84739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 30 22:37:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Volume volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 (f52eae3f-e0cb-4b66-b97a-f832aab34331): created successfully Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b94f2eb-b3aa-4147-a29c-3e096df84739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Flow 'volume_create_manager' (c027fcef-334d-45d1-a48e-aec5e8dba276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 30 22:37:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4d730c4b-ce22-4e57-a140-ca0eab2cb0fc tempest-ProjectReaderTests-949744717 None] Created volume successfully. Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Acquiring lock "cinder-f52eae3f-e0cb-4b66-b97a-f832aab34331-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Lock "cinder-f52eae3f-e0cb-4b66-b97a-f832aab34331-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Acquiring lock "cinder-quobyte-f52eae3f-e0cb-4b66-b97a-f832aab34331" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Lock "cinder-quobyte-f52eae3f-e0cb-4b66-b97a-f832aab34331" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3ddae5-1317-4e57-b242-f09d8171538c]: (4, 'qcow2') {{(pid=89111) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:39 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 Sep 30 22:37:39 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:39 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331" returned: 0 in 0.347s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:39 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331 Sep 30 22:37:39 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:40 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146/volume-f52eae3f-e0cb-4b66-b97a-f832aab34331" returned: 0 in 0.235s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Lock "cinder-quobyte-f52eae3f-e0cb-4b66-b97a-f832aab34331" released by "delete_volume" :: held 0.619s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Created reservations ['a6fd89b8-9913-47f7-9570-f5ad64fe53e3', '20b3b96e-3535-40d8-a235-d18a42104c83', 'b75dbb22-7de8-48a4-99a4-cc6f574ea299', 'd9a7622e-5cf0-4eea-adc2-ced4711b43aa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:37:40 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:37:40 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:37:40 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.231s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:37:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Deleted volume successfully. Sep 30 22:37:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6971e05-f6cc-4b77-9064-0d2eaf453e1d tempest-ProjectReaderTests-949744717 None] Lock "cinder-f52eae3f-e0cb-4b66-b97a-f832aab34331-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 30 22:37:50 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=22 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:37:50 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=12,cinder:UPDATE=22,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cd763c5e-7ae1-45a8-b5a8-209d88677816'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 30 22:38:03 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146 Sep 30 22:38:03 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 30 22:38:03 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/13d8d1903bdbea704a6e71b2d98a1146" returned: 0 in 0.243s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 30 22:38:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-420800f8-016f-4ef1-841c-9d519a3b3f7e None None] thread info: [<_MainThread(MainThread, started 135825578885248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}